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(54) INFORMATION PROCESSING APPARATUS AND METHOD, PROGRAM, AND RECORDED 
MEDIUM 



(57) In case continuous reproduction is commanded 
from a first AV stream to a second AV stream, a third AV 
streanri, made up of a preset portion of the first AV 
stream and a preset portion of the second AV stream, ' 
Is generated. The third AV stream la reproduced when 
reproduction is switched from the first AV stream to the 
second AV stream. As the intomnat|on pertinent to the 



third Ay stream, the address Infomnatlon of a source 
pacicet of theflrst AV stream at a timing of switching from 
the first AV stream to the third AV etream and the ad-. 
. dress infonnnation of a source pacicet of the second AV 
stream at a timing of switching from the third AV stream 
to the second AV stream, are generated. This enables 
reproduction such as to maintain continuity betweeii 
separately recorded AV streams. 
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i)Merlptlon . 

Technical Field 

5 [0001 ] This Invention relates to an lnrorma1}on processing method and apparatus, a program, and a recording medium 
and, more particularty, to an Information processing method and apparatus, a program and a recording medium, con- 
figured for maintaining oonUnuity of moving pictures In a reproducing domain. 

Background Art 

10 

[0002] Recently, a variety of types of optical discs have been proposed as a recording nwdlum that can bo removed 
from a recording apparatus. These recordable optical discs have been proposed as a large capacity medium of several 
QBs and are thought to be promising as a medium for recording AV (audio visual) elgnala, such as video signals. 
Among the digital AV signal sources (supply sources), to be recorded on this recordable optical disc, there are CS 
» digital satellite broadcast and BS digital broadcast. Additionally, the ground wave television broadcast of the digital 
system has also been proposed for future use. 

[0003] The digital video signals, supplied from these sources, dre routinely compressed under the MPEG (Moving 
Picture Experts Group) 2 system, in a recording apparatus, a recording rate proper to the apparatus Is set. If digital 
video signals of the digital broadcast are recorded In the conventional Image storage mediums for domestic use, digital 
so video signals are first decoded and subsequently bandwidth-limited for recording. In the case of the digital recording 
system, including, of course, the MPEG1 Video, MPEG2 video and The present Invention provides an DV systems, 
digital video signals are first decoded and subsequently re-encoded In accordance with an encoding systern for the 
recording rate proper to the apparatus for recording subsequently. 

[0004] However, this recording system, In which the supplied bitstream is decoded once and subsequently band- 
25 width-limited and re-encoded prior to recording, suffers from deteriorated picture quality. If, In recording compressed 
video digital signals, the transmission rate of Input digital signals is less than the recording rate for the recording and/ 
or reproducing apparatus, the method of directly recording the supplied bitstream without decoding or re-encoding 
suffers from deterioration in the picture quality only to the least extent. However, If the transmission rate of the Input 
digital signals exceeds the recording rate of the recording and/or reproducing apparatus, tt Is Indeed necessary to re- 
30 encode the bitstream and to record the so-re-encoded bitstream, so that, after decoding In the recording and/or repro- 
ducing apparatus, the transmission rate will be not higher than the upper limit of the disc recording rate. 
[0005] If the bitstream is transmitted in a variable rate system in which the bit rate of the Input digital signal is Increased 
or decreased with time, the capacity of the recording medium can be exploited less wastefully In the case of a disc 
recording apparatus adapted for transiently storing data In a buffer and for recording the data in a burst fashion than 
39 In the case of a tape recording system having a fixed reconding rate imposed by the fixed rpm of the rotary head. 
[0006] Thus, it may be predicted that. In the near future when the digital broadcast Is to become the mainstream, 
increasing denriand will be raised for a recording and/or reproducing apparatus In which broadcast slgriais are recorded 
as digital signals, without decoding or re-encoding, as In a data streamer, and In whicfi a disc is used as a recording 
medium. 

^ [0007] In reproducing data recorded on a recording medium In the above-desoribod recording apparatus, there Is 
known so-called sidp reproduction in which reproduction is continued up to a preset picture and a plcture temporally 
spaced apart frorn the preset picture Is reproduced next. This skip reproduction has a drawback that temporal continui^ 
is lost In the reproduced pictures. 

^ Disclosure of the invention 

[0006] It Is therefore an object of the present invention to enable reproduction such as to maintain continuity of moving 
pictures in the playback domain. 

[0009] The present Invention provkies an infomnatlbn processing apparatus including generating means for gener- 
so attng. In case continuous reproduction from a first AV stream to a second AV stream Is commanded, a third AV stream 
made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream 
being reproduced when reproduction Is switched from the first AV stream to the second AV stream, and the address 
Infonmation, as the ihfomnation pertinent to the third AV stream, the address Information being made up of the Information 
on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first AV etream 
» to the third AV stream, and of the Information on the address of a source packet of the second AV stream at a timing 
of switching of reproduction from the third AV stream to the second AV stream, and recording means for recording the 
third AV stream and the address information, as generated by the generating means. 

[0010] Preferably, an anival time stamp of th.e source packet of the first AV stream Included in the address informatton 
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generated by the generating means, and an arrival time stamp of a source packet located at a leading end of the third 

AV stream, are continuous to each other, and an an^lval time stamp of the source packet of the second AV stream 
Included In the address^ Infomiation generated by the generating means and an arrival time stamp of a source packet 
located at a trailing end of the third AV stream are continuous to each other. 
5 [0011] Preferably, a sole discontinuous point exists in the arrival time stamp of the souroe packet In the third AV 
stream. 

[0012] Preferably, the address is detennlned so that a data portion of the AV stream previous to a source packet 
specified by the infomiation on the address of the source packet of the first AV stream contained in the address infor- 
mation generated by the generating means will be located In a continuous area of not less than a preset size on a 

10 recording medium. 

[0013] Preferably, the address Is detennined so that a data portion of the AV stream subsequent to a source packet 
specified by the infonnatton on the address of the source packet of the second AV stream contained In the isddress 
information generated by the generating means will be located In a continuous area of not less than a preset size on 
a recording medium. 

15 [0014] Preferably, the third AV stream is generated so that the third AV stream will be located In a continuous area 
of not less than a preset size on the recording medium. . 

[001 5] The present inventton also provides an infomiation generating method Including a step of generating, In case 
continuous rsproductton from a firbt AV stream to a second AV stream Is commanded, a third AV stream made up of 
a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream being repro- 

SO duced when reproduction Is switched from the first AV stream to the second AV strearh, and a step of generating the 
address infonnation, as the. information pertinent to the third AV stream, the address infomiation being made up of the 
infomiation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
. first AV stream to the third AV stream, and of the Information on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 

^ [0016] The present friventlpn also provides a recording medium having nacorded thereon a computer-readable pro- 
gram, in which the program inckJdes a step of generating, In case continuous reproduction from a first AV stream to a 
second AV stream is comrhanded, a third AV stream made up of a preset portion of the first AV stream and a preset 
portion of the second AV stream, the third AV stream being reproduced when reproduction is switched from the first 
AV stream to the second AV streami and a step of generating the address infonmatton. as the infomiation pertinent to 

30 the third AV stream, the address Infonnation being made up of the Infpmnatkin on an address of a source packet of 
the first AV stream at a timing of switching of reproduction from the first AV stream to ttie third AV stream, and of the 
Information on the address of a source packet of the second AV stream at a timing of switching of reproduction from 
the third AV stream to the second AV stream. 

[001 7] The present invention also provides a program for havinga conrputer execute a program, in which the program 
35 includes a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream, the third AV stream being reproduced when reproduction is switched from the first AV stream to the second 
AV stream, and a step of generating the address infonnation, as the information pertinent to the third AV stream, the 
address infonnation being made up of the Information on an. address of a souroe packet of the first AV stream at a 
40 timing of switching of reproduction from the first AV stream to the third AV stream, and of the Information on the addrsse 
of a source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the 
second AV stream. 

[0018] The present invention also provides an infonnation processing apparatus including first readout means for 
. reading out a first AV stream, a second Ay stream or a third AV stream from a recording medium, second readout 

45 . means for reading out, as the infonnation pertinent to the third AV stream, the information on an address of a souroe. 
packet of the first AV stream at a timing of switching of reproduction from the first AV strejam to the third AV stream; 
and of the Information on the address of a source packet of thesecond AV stream at a timing of switching of reproductk>n 
from the third AV stream to the second AV stream, and reproducing means tor perfomiing reproduction as reproduction 
is switched from the first AV stream read out by the first readout means to the third AV stream and from the third AV 

so stream to the second. AV stream, based on the infonnation pertinent to the third AV stream read out by the second 
readout means. 

[0019] The present lnventk>n also proykies an infonnation processing method Including a first readout comrolling 
step of reading out a first AV stream, a secorid AV stream er a third AV stream from a recording medium, a second 
readout Controlling step of reading out, as the infonnation pertinent to thethird AV stream, the Information on an address 
. » of. a source packet of the first AV stream at a timing of switchffig of reproduction from the first AV strearn to the third 
AV stream, and of the infonnation on the address of a source packet of the second AV stream at a timing of switching 
of reproduction from the third AV stream to the second AV stream, and a reproducing step of perfonning repr6du(^k>n 
as reproduction Is switched from the first AV stream read out by the first readout rheans to the third AV stream and 
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• from the third AV stream to the second AV stream, based on the Infomnatlon pertinent to the third AV stream read out 
by the second readout means. 

[0020] The present invention also provides a recording medium having recorded thereon a computer-readable pro- 
. gram, in which the program includes a first readout controlling step of reading out a first AV stream, a second AV stream 

9 or a third AV stream from a recording medium, a second readout controlling step of reading out, as the Infomiatton 
pertlnonl to the third AV stream, the Information on an address of a source paclcel of the first AV stream at a liming of 
switching of reproducUon from the first AV stream to the third AV stream, and of the information on the address of a 
source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the second 
AV stream, and a reproducing step of perfonmlng reproduction as reproduction Is switched from the first AV stream 

10 read out by the first readout means to the third AV stream and from the third AV stream to the second AV stream, based 
on the infomrmtion pertinent to the third AV stream read out by the second readout moans. 

lOOaiJ The present invention also provides a program for haying a computer execute aprogram, In which the program 
includes a first readout contiolling stop of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium, a second readout controlling step of reading out, as the Information pertinent to the third AV 

w stream, the Infomiatlon on an address of a source packet of the first AV stream at a timing of switching of reproduction 
from the first AV stream to the third AV stream, and of the Information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, and a reproducing 
step of perfomiing reproductk>n as reproduction Is switched from the first AV stream read out by the first readout means 
to the third AV stream and from the third AV stream to the second AV stream, based on the Information pertinent to 

^ the third AV stream read out by the second readout means. 

[0022] The present Invention also provides a recording medium having recorded thereon the address Infomnation 
including. In case continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV 
stream made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV 
stream being reproduced when reproduction Is switched from the first AV stream to the second AV stream, and the 

^ address Information, as the tnfomniation pertinent to the third AV stream, the address Information being made up of the 
Information on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the Infomnation on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 
[0023] In the Information processing method and apparatus, and the program, according to the present Invention, If 

^ the it Is commanded to perfomn reproductton continuously from the first AV stream to the second AV stream, there Is 
generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which is reproduced when reproduction Is switched from the first AV stream to the second AV stream, while 
there is generate<), as the Information pertinent to the third AV stream, the address infonmation made up of the infor- 
mation on an address of a source packet of the first AV stream at a tlnrilng of switching of reproduction from the first 

^ AV stream to the third AV stream, and of the Information on the address of a source packet of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. 

[0024] in the information processing method and apparatus, and the program, according to the present Invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address information 
made up of the inf omriation on an address of a source packet of th e first AV stream at a timi ng of switching of reproduction 

^ from the first AV stream to the third AV stream, and the Infomnation on the address of a source packet of the seocnd 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, is read out from 
the recording medium as the information pertinent to the third AV stream, and reproduction is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based oh the read-out Infonratlon pertinent to the third AV stream. 

45 [002B] Other objects, features and advantages of the present Invention will become more apparent from reading the 
embodiments of the present Invention as shown In the drawings. 

Brief Oescrlption of the Drawings 

50 [0026] 

Fig. 1 shows aconflguratlon of an embodiment of a recording and/or reproducing apparatus according to the present 
Invention. 

Flg.2 Illustrates the data fonmat of data recorded on a recording n^edlum by a recording and/or reproducing appa- 
55 ratU8l. 

Flg.3 illustrates Real PiayList and Virtual Play List. 

Figs.4A, 4B and AC Illustrate the creation of the Real PiayList. 

Ftgs.5A, 5B and 6C Illustrate deletion of the Real PlayLlst. 
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Flg8.6A and 6B Illustrate assemble editing. 

Flg.7 Illustrates provision of a sub path In the Virtual PlayLlst. 

Fig.8 Illustrates the changing of the playback sequence of the PlayLlst. 

Fig.9 illustrates a mark on the PlayLlst and a mark on the Clip. 

Flg.10 Illustrates a menu thumbnail. 

Flg.11 illustrates mark added lo the PlayLlst. 

Fig.12 Illustrates a maric added to the Clip. 

Fig.13 illustrates the relation between the PlayLlst, Clip and the thumbnail file. 

Fig.14 illustrates a directory structure. . 

Fig.15 Illustrates a syntax of infr.dvr. 

Flg.16 shows a syntax of DVRVolumo. 

Flg.17 shows a syntax of ResumeVolume. 

Rg.18 shows a syntax of UlApplnfoVolume. 

Fig. 1 9 shows a table of character set values. 

Fig.20 shows a syntax of TableOf PlayLlst. 

Flg.21 shows another syntax of TableOf PlayUst, 

Fig.22 shows a syntax of the MakersPrtvateOata. 

Rg.23 shows a syntax of xxxx.rpis and yyyy.vpls. 

Flgs.24A to 24C Illustrate the PlayLlst 

Fig.25 shows a syntax of PlayLlst 

Fig^6 shows a table of PlayUst.type. 

Flg.27 shows a syntax of UlApplnfoPlayList. 

Flg8.28A to 28C illustrate flags In the UlApplnfoPlayUst syntax shown in Fig.27. 

Flg.29 illustr^tes a Pjayltem. 

Fig.30 Illustrates a Play Item. 

Fig.31 illustrates a Playltem. 

Fig.32 shows a syntax of the Playltem! 

FIg.33 iliusUates llSi-time.' 

Rg.34 Illustrates OUT-time. 

Fig.36 shows a table of Connection_Condltk>n. 

FI98.36A to 36D liiustrato Connectlon_Conditk>n.. 

Flg.37 illustrates BridgeSequencelnto. 

Flg.38 shows a syntax of BrldgeSequenoeinfo. 

Fig.39 Illustrates SubPlayltem. 

Fig.40 shows a syntax of SubPlayltem. 

Fi^,41 shows a table of Mark.type. 

Flg.42 shows a syntax of PlayLlstMark. 

Flg.43 shows a table of MarkLtype. 

Flg.44 Illustrates MarKJme^stamp. 

Rg.46 shows a syntax of zzz2Z.cllp. 

Rg.46 shows a syntax of Cllplnfo. 

Rg.47 shows a table.of Clip_stream_type, 

Fig.48 Illustrates offset.SPN. 

Flg.49 Illustrates off86t_SPN. 

Rg8.50A, 508 illustrate the STC domain. 

Rg.51 Illustrates STCJnfo. 

Flg.52 shows a syntax of STC.Info. 

Fig.53 illustrates Programlnfo.. 

Fig.64 shows a syntax of Programlnfo. 

Fig .56 shows a syntax of VideoCondinglnfo. 

Fig.56 shows a table of VIdeoJormat 

Fig.67 shows a table of frame.rate. 

Fig^8 shows a table of clisplay.aspect^ratlo. 

Fig.59 shpws a syntax of AudtoCondinglnfo. 

Fig.60 shows a table of audlo^coding. 

Fig.61 shows a table of audlo.component.type. 

Flg.62 shows a table of sampllng_frequency. 

Flg.e3 Illustrates CPi. 
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Flg.64 illustrates CPL 

Fig.65 shows a syntax of CPI . 

Fig.ea shows a table of CPLtype. 

Flg.67 illustrates video EP.map. 
5 Fig.68 Illustrates EP^map. 

Fig.69 lllustrales EP.map. 

Flg,70 shows a syntax of EP_map. 

Rg.71 shows a table of EP.typevalues. 

Flg.72 shows a syntax of EP_mapJor_one_stream_PlD. 
10 Flg.73 Illustrates TU_map. 

Fig.74 shows a syntax of TU_map. 

Fig.76 shows a syntax of ClipMark. 

Flg.76 shows a table of Mark_type. 

Fig J7 shows a table of Mai1(_type_stanip. 
« Flg.78 shows a syntax of menu.thmb and mark.thmb. 

FIgjg shows the syntax of thumbnail. 

Flg.80 shows a table of thumbnail j)lcture_fomnat. 

Flgs.81 A and 81 Blllustrate In.block. 

Fig.82 illustrates a stmcture of a transport stream of DVR M PEG2. 
^ Fig.63 shows a recorder model of a transport stream of DVR MPEG2. 

Fig.84 shows a player model of a transport stream of DVR MPEG2. 

Flg.85 shows the syntax of a source packet. 

Flg.86 shows the syntax of TP_extra_header 

Flg.87 shows a table of a copy permission indicator. 
^ Flg.88 illustrates seamless connection. 

Flg.89 Illustrates seamless connection. 

Fig.90 lllustratas seamless connection. 

Flg.91 illustrates seamless connection. 

Rg.92 illustrates seamless connection. 
30 Fig.9d Illustrates audio overlap. 

Fig.94 Illustrates seamless connection employing BrldgeSequence. 

Flg.95 Illustrates seamless connection not employing BrldgeSequence. 

Rg.98 shows a DVR STD model. 

Fig.97 is a timing chart for decoding and display. 
3s Fig.98 shows another syntax of BridgeSequencelnfo. 

Flg.99 Illustrates Bridge^Cllp when two Playltems are seamlessly connected. 

Flg.l 00 shows a syntax of a Clip Inf omiation file. 

Flg.10i shows a syntax of a Cllpinfo of the Clip Information file of Fig.1 00, 

Flg.l 02 shows a syntax of a Sequencelnfo of the Clip Inforniatlon tile of Fig.100. 
^ Flg8.103A and 1 03B Illustrate database change in case stream data of the Clip AV stream file Is partially erased. 

Fig.1 04 Is a flowchart for illustrating the preparation of a RealPlayList. 

Flg.l 05 Is a fk>wchart for Illustrating the formulation of a Virtual PlayLlst. 

Flg.1 06 Is a fbwchart for Illustrating the fomiuiation of a bridge sequence. 

Fig.1 07 Is a flowchart for Illustrating the reproduction of PlayLlst, 
^ FIg.lOB Illustrates a medium. 

Best Mode for Carrying out the Invention 

C00271 Refening to the drawings, present embodiment of the present Invention will be explained in detail. Fig. 1 shows 
» a typteal Inner structure of a recording and/or reproducing apparatus 1 embodying the present invention. First, the 
structure of a recording unit 2, configured for recording signats input from outside, is explained. The recording and/or 
reproducing apparatus 1 is configured for b0ing fed with and recording analog or digital data. 
(002B] Anak>g video signals and analog audio signals are fed to terminals 11,12, respectively. The video signals, 
Input to the tamilnal 11 , are output to an analysis unit 14 and to an AV encoder 15. The audio signals, input to the 
w tenmlnal 12, are output to the analysis unit 14 and to the AV encoder 15. The analysis unit 14 extrocts feature points, 
such as scene changes, from the input video and audio signals. 

[0029] The AV encoder 16 encodes Input video and audio signal to output the system Infomnatlon (S), such as an 
encoded video stream (V). an encoded audk> stream (A) and AV synchronization, to a multiplexer 16. 
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. «| [0030] The encoded video stream Is a video stream encoded e.g., with the MPEG (Moving Picture Expert Group) 2 

I . . system, whilst the encoded audio stream Is an audio stream encoded In accorclance witfi the MPEG1 system, with the . 

I encoded audio stream being e.g., an audio stream encoded in e.g., the MPEG1 system or an audio stream encoded 

/ In accordance with the Dolby AC3 (trademak) system. The multiplexer 1 6 multlplexesthe Input video andaudio streams, 

I 5 . based on the input system Information, to output a multiplexed stream through a switch 17 to a multiplexed stream 

.j. ' analysis unit 18 and to a source packetlzer 19: . 

I [0031] The multiplexed stream is e.g.. an i^PEG-2 transport stream or an MPEG2 program stream. The source 
packetizer 19 encodes the Input multiplexed stream Into an AV stream composed of source packets in accordance 

j .. with an application fomiat of a recording medium 100 on whteh to record the stream. The AV stream is processed in 

\ 10 ECC (en^or correctton and coding) unit 20 and a modulation unit 21 with appendage of ECC codes and with modulation, 
before being output to a write unit 22, whtoh then writes (records) an AV stream file based on a control signals output 

I by the controller 23. . . 

j [0032] The transport stream, such as digital television broadcast, input from a digital interface or a digital television 

I tuner, is input to a tenminal 1 3. There are two recording systems for recording the transport stream input to the temilnal 

I 15 13, one being a transparent recording system and the other being a system in which recording is preceded by re- 

f encoding aimed to lower e.g., the recording bit rate, the recording system command infonnation is input from a temnlnal 

[ 24 as a user Interface to a controller 23. 

I . [0033] In the transparent recording of the Input transport stream, a transport stream. Input to a terminal 1 3, is output 

! through a switch 1 7 to a multiplexed stream^nalysis unit 1 8 and to the source packetizer 1 9. The ensuing processing 

1 £0 of recording an AV stream on a recording medium is the same as that of encoding and recording analog input audio 

; ' and video signals, as described above, and hence is not explained here for simplicity. 

. ; [0034] If the Input transport stream Is re;«ncoded and subsequently recorded, the transport stream, Input to the 

I terminal 13, is fed to a demultiplexer 26, which demultiplexes the input transport stream to extract a video stream (V), 

i an audio stream (A) and the system Infomiation(S). 

i 2S [0035] Of the stream (irifonnation), as extracted by the demultiplexer 26, the video stream is output to an audio 

I decoder 27, whilst the audio stream and the system. Infonnation are output to the multiplexer 16. The audio decoder 

1 27 decodes the Input transport stream to output the encoded video stream (V) to the multiplexer 16. 

I , [0036] The audio stream and the system information, output from the demuitiptexer 26 and input to the. multiplexer 

. . r 16, and the video stream, output by the AV encoder 15, are multiplexed, based on the input system infomiatton, and 
30 output to the multiplexed stream analysis unit 1 8 and to the source packetizer .1 9 tiirough switch 1 7, as a multiplexed 

^ stream. The ensuing processing of recording an AV stream on a recording medium is the same as that of encoding 

I and recording analog Input audio and video signals, as described above., and hence Is not explained here for simplicity. 

; [0037] The recording and/or reproducing apparatus 1 of the present embodiment records aflie of the AV stream on 

j the recording medium 1 00, while also recording the applk^atlon database information whteh accounts for the file. The 

I 35 Input information to the controller 23 is the feature information for the moving pteture from the analysis unit 14, the 

j feature infonrtktlon of the AV stream from the multiplexed stream analysis unit 1 8 and the user command information 

•j . Input at a terminal 24. 

• [0038] The feature infonnation of the moving ptetur^, supplied from the analysis unit 1 4, is generated by the analysis 

■ I unit 1 4 when the AV encoder 1 5 encodes video signals. The analysis unit 1 4 analyzes the contents of the input video 

I 40 and audio.signals.to generate the infonnation pertinent to the pictures characteristic of the Input moving pteture signals 

j (clip mark), this Information is the infonnation Indicating a picture of characteristic clip mark points, such as program 

i start points, scene change points, CM commercial start and end points, title or telop in input video signals, and also 

1 includes a thumbnail of the picture and the infonnation pertinent to stereo/monaural switching points and muted porttons 

I of audio signals. 

I 45 [0039] The alcove picture Indibating Information Is fed through controller 23 to the multiplexer 16. When multiplexing 

. j a encoded picture specified as clip mark by the controller 23, the multiplexer 1 6 returns the Infonnation for specifying 

. I the encoded picture on the AV stream to the controller 23. Specifically, this information is the PTS (presentation time 

I stamp) of a picture or the address informatton on the AV stream of an encoded version of the picture. The controller 

\ 23 stores the sort of feature pictures and the Infonnation for specifying the encoded picture on the AV stream in asso- 

l so elation with each other. 

i [0040] The feature infonnation of the AV streiam from the multiplexed stream analysis unit 18 Is the infpnnatlbn 

) pertinent to the encoding information of the AV stream to be recorded, and is recorded by an analysis unit 18. For 

j example, the feature infomiatlon includes the tbne stamp and address Infomiation of the 1-picture In the AV stream, 

j discontinuous point Infomfiation of system time clocks, encoding parameters of the AV stream and change point infor- 

. j 55 mation of the encoding parameters In the AV stream. When transparently-recording the transport stream, input from 

\ the tennlnai 13, the multiplexed stream analysis unit 1 8 detects the picture of the iaforementioned clip mark, f rorn the 

] . input transport stream, and generates the infonnation for specifying a picture designated by the clip mark and its type . 

. i [0041] The user designatton infonnation from the temnlnal 24 is the infomiatlon specifying the playback domain; 
j 

\ ' ' . * ■ 
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designated by the user, character letters for explaining the contents of the playback domain, or the information such 
as bookmarks or resuming points set by the user for his or her favorite scene. 

[0042] Based on the aforementioned Input Information, the controller 23 creates a database of the AV stream (Clip), 
a database of a group (PlayList) of playback domains (Playltem) of the AV stream, management information of the 
s recorded contents of the recording medium 100 (Info.dvr) and the Information on thumbnail pictures. Similarly to the 
AV stream, the application database information, constructed from the above Information, is processed in the ECC unit 
20 and the modulation unit 2t and input to the write unit 22, whk:h then records a database file on the recording medium 
100. 

[0043] The above-described appiteatlon database infomnatlon will be exptained subsequently In detail. 

10 [0044] When the AV stream file recorded on the recording medium 1 00 (files of pteture data and speech data) and 
the application database infomnatton, thus recorded on the recording medium 100, are reproduced by a reproducing 
unit 3, the controller 23 first commands a readout unit 28 to read out the application database infonmatlon from the 
recording medium 1 00. The readout unit 28 reads out the application database information from the recording medium 
100, which then reads out the application database infonnatloh from the recording medium 1 00 to send the application 

IS database Information through demodulation and en^or con-ectlon processing by a demodulating unit 29 and an ECC 
decoder 30 to the controller 23. 

[0045] Based on the application database infomiation, the controller 23 outputs a list of PlayList recorded on the 
recording medium 1 00 to a user interfacia of the tenrtinal 24. The user selects the PlayList, desired to be reproduced, 
from the list of PlayLists. The Infonnatton pertinent to PlayList. specified to be reproduced, Is input to the controller 23. 
20 The controller 23 commands the readout unit 28 to read out the AV stream file necessary In reproducing the PlayList. 
in accordance with the command, the readout unit 28 reads out the con'e^ondlng AV stream from the recording 
medium 1 00 to output the read-out AV stream to the demodulating unit 29. The AV stream, thus input to the demodu- 
lating unit 29, Is demodulated by preset processing and output through the processing by the ECC decoder 30 to a 
source depackettzer 31 . 

^ (004CJ The source depacketizer 31 converts the AV stream of the application fomiat, read out from the recording 
medium 1 00 and processed in a preset fashion, Into a stream processable by the demultiplexer 26. The demultiplexer 
26 outputs the systehfi information (S), such as the video stream (V), audio stream (A) or the AV synchronization, 
fomiing the playback domain (Playltem) of the AV stream specified by the controller 23, to the audio decoder 27. whteh 
AV decoder 27 decodes the video stream and the audio stream to output the playback video signal and the playback 

30 audio signal to associated temninais 32, 33, respectively 

[0047] if fed from the terminal 24, as a user Interface, with the Infomiation Instructing random access playback or 
special playback, the controller 23 datennines the readout position of the AV stream from the recording medium 100, 
based on the contents of the database (Clip) of the AV stream, to command the readout unit 28 to read out the AV 
stream. If the PlayList as selected by the user Is to be reproduced as from a preset time point, the controller 23 com- 

ss mands the readout unit 28 to read out data from an i-plcture having a time stamp ctoeest to the specified time point. 
[0048] When the user has selected a certain clip mark from Indexing points or scene change points for the program 
stored In the ClipMark In the Clip information, as when the user selects a certain picture from a list of thumbnail pictures, 
as demonstrated on a user Interface, of the indexing points or scene change points stored in the ClipMark, the controller 
23 detemilnes the AV stream readout position from the recording medium 100 to command the readout unit 28 to read 

40 out the AV stream. That (s, the controller 23 commands the readout unit 28 to read out data from an i-picture having 
an address closest to the address on the AV stream which has stored the picture selected by the user. The readout 
unit 28 reads out data from the specified address . The read-out data is processed by the demodulating unit 29, ECC 
decoder 30 and by the source packetlzer 1 0 so as to be supplied to the demultlplexer 26 and decoded by the audio 
decoder 27 to reproduce AV data Indicated by an address of the mark point picture. 

45 [0049] If the user has commanded fastfonvard playback, the controller 23 commands the readout unit 28 to sequen- 
tially read out iidicture data in the AV stream in succession based on the database (Clip) of the AV stream. 
[0050] . The readout unit 28 reads out data of the AV stream from a specified random access point. The so read-out 
data Is reproduced through processing by various components on the downstream side. 

[0051] The case In whteh the user edits the AV stream recorded on the recording medium 1 00 is now explained, if 
so desired to specify a playback domain for the AV stream recorded on the recording medium 100, for example, If desired 
to create a playback route of reproducing a portion sung by a singer A from a song program A* and subsequently 
reproducing a portion sung by the same singer A from another song program B. the infomiation pertinent to a beginning 
point (IN-point) and an end point (OUT-poInt) of the playback domain is Input to the controller 23 from the terminal as 
a user Interface. The controller 23 creates a database of the group (PlayList) of playback domains (Playltem) of the 
s$ AV streams. 

[0052] When the user desires to erase a portion of the AV stream recorded on the recording medium 1 00, the Infor- 
mation pertinent to the IN-point and the OUT-point of the erasure domain Is input to the controller 23, which then 
■ modifies the database of the PlayList so as to refer to only the needed AV streams. The controller 23 also conrunands 
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the wrfte unit 22 to erase an Mnneed^ 

[0053) .The case in which the user desires to specify playback domains of an AV stream recorded on the recording 
medium to create a new piaybeiclc route, and to Interconnect the respebtlve playback domains In a seamless fashion, 
is now explained, In such caise, the controller 23 creates a database of a group (PlayLlst) of the. playback domains 
5 (Piayitem) of the AV stream and undertakes to. partially re-encoda and re-multiplex the video stream In the vicinity of 
junction points of the piayback domains. 

[0054] The picture infonmatton at the IN-point and that at the OUt-pol nt of a playback domain are Input from a terminal 
. 24 to a controller 23. The controller 23 commands the readout unit 28 to read out data needed to reproduce the pictures 
at the IN-poInt and at the OUT-polnt. The readout unit 28 reads oUt data from the recording, medium 1 00. The data so 
10 read out is output through the deijiodulatlng unit 29, ECC decoder 30 and the source packetizer 1 9 to the demultiplexer 

' . 26; • ■ .•*••' 

[00S5] The controtler 23 anaiyzes data input to the demultiplexer 26 to detemrilne the re-encodhg nf>ethod for the 
• video stream (change of plcture.codlng^^type and asslgnnwnt of the quantity of encoding bits for re-encoding) and th^ 
ro-muitiplexing system to send the system to the AV encoder 15 and to the multiplexer 1 6. 
*5 . [0056] The demultiplexer 26 then separates the Input stream Into the video stream (V), audio stream (A) and the 
systpm Intomnatlon (S). The video stream may be classed Into data input to the audio decoder 27 and data input to 
the multiplexer 16. The former Is data needed for. re-encoding, and Is decoded by the audio decoder 27, with the 
. decoded picture being then re-encoded by the AV encoder 1 5 and thereby caused to become, a video stream. The 
. . tatter data Is data copied from an original streani. without re-encoding. The audio stream and the system infdninetion 
^ are directly input to the multiplexer 16. 

[0057] The multiplexer 1 6 multiplexes ar> Input stream, based on the Infomiatlon input from the controller 23, to output 
a multiplexed stream, whteh Is processed by the ECC unit 20 and the modulation unit 21 so as to be sent to the write 
unit 22. The write unit 22 records an AV stream on ttie recording medium 100 bas^d on the control signals supplied 
» from the controller 23. 

25 [0058] the application database information and the operation based on this information, such as playback and 
editing, are hereinafter explained. Rg.2 shows the structure of an applicatton format having two layers, that is PiayLlst 
and Cl]p» for AV stream management. The Volume Information manages all Clips and PlayLlsts In the disc. Here, one 
AV stream and the ancillary infomnatlon thereof, paired together, Is deemed to be an object, and Is termed Clip. The 
AV stream file is termed a Clip AV stream file, with the ancillary infonrtatlon being tenned the Clip Irifomnation file. . 

30 [0059] One Clip AV stream^file stores data corresponding to an MPEG-2 transport stream anranged in a structure . 
prescribed by the applteatlohfomiat. By and large, a file Is treated as a t)yte string. The contents of the Clip AV stream 
file are expanded on the time axis, with entry points in the Clip (l-picturej belng.malnly specified on the time basis. 
When a time stamp of an access point to a preset Clip is given, the Clip Information file.ls useful In finding the address 
Information at which to start data readout in the Qip AV stream file. 

35 [0060] ReferrlngtoFlg.3,PlayU8tisnowexplained,whichlsprovldedforausert08electaplaybackd^^ 

to be viewed from tfie Clip and to edit tiie playback domain readily. One PiayLlst is a set of playback domairis In the 
Clip. One playback domain iri a pi'eset Clip is terrhed Piayitem and is represented by a pair of an I N-point and an OUT- 
point on the time axis. So, the. PlayLlst is formed by a set of plural Piayitems. 

[0061] . The PlayLlst Is classified into two types, one of which is Real f^layUst and the other of which is Virtual PlayLlst.. 
^ The Real PiayLlst co:Owns stream portions of the Clip it Is referencing. That Is, the Real PlayUst takes up in the cflsc 
the data papaclty con-espondlng to a stream portion of the Clip it is referencinq.arid, when Real PiayList is erased, the 
data,of tile stream portion of the Clip it is refei|encir}g Js also erased. . . 

[0062] The Virtual PlayLlst Is rtox co-owning Clip data. Therefore, if the Virtual PlayLlst is changed or erased, the 
contents of the Clip are in no way changed. . 

^ [0063] The editing of the Real Playlist is explained. Flg.4A shows creation of Real PlayLlst and, if the AV stream is 
recorded as a hew Clip, the Real PlayLlst which references the entire Clip is a newly creat 
[0064] Fig.4B shows the division of the real PlayLlst. that is the operation of dividing the Real PlayLlst at a desired 
. point to split the Real PlayLlst In two Real PlayLlsts. This division operation is perfomned when two programs are 
managed in one clip managed by a sole PlayLlst and when the user intends to re-reglster or re-rebord the programs . 

so as separate Indh^idial programs. This operation do^s not lead to alteration of the Clip contents, that is to division of 
the Clip Itself. ■ 

[0065] Fig.4C shows the combining operatbn of the Real PlayLlst whteh Is the operation of combining two Real 
PlayLlsts Into one new Real PlayLlst. This. combining operatnn Is perfonrned sgch as when the user desires to re- 
register two programs as a sole program. This operiatton does not lead to alteration of the Clip contents, that is to 
^ combihing the clip itself Into one. 

[0066] FIg.SA shows deletion of the entire Real PlayLlst. If thQ operatk>n of erasing the entire preset Real PlayUst, 

the associated stream portion of the Clip referenced by the deleted Real PlayLlst is also deleted. 

[0067] Flg.SB shows, partial deletion of the Real PlayLlst. If a desired portion of the l=leal PlayLlst Is deleted, the 
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associated Playltem Is altered to reference onjy the needed Clip stream portion. The conreeponding stream portion of 
the Clip Is deleted. 

[0068] Fig.SC shows the nolnimlzlng of the Real PlayList. It Is an operation of causing the Playltem associated with, 
the Real PlayList to reference only the stream portion of the Clip needed for Virtual PlayList. The cbnresponding stream 

9 portion of the Clip not needed for the Virtual PlayList Is deleted. 

[OOeS] If the Real PlayLIsi Is changed by the above-described operation such that the stream portion of the Clip 
. referenced by the Real PlayList is deleted, therejs a possibility that the Virtual PlayList employing the deleted Clip Is 
present euch that problems may be produced In the Virtual PlayList due to the deleted Clip. 
[0070] In order to prevent this from occuning, such a message which runs: "If there exists the Virtual Play List ref- 

10 erencing the stream portion of the Clip the Real PlayList is referencing, and the Real PlayList is dejeted, the Virtual 
PlayList Itself Is deleted - is It all right?" Is displayed for the user In response to the user's operation of deletion by way 
of conflnnation or alamilng, after which the processing for deletion Is executed oroancelled subject to user's commands. 
Alternatively, the minimizing operation for the Real PlayList is perfonned In pl^ce of deleting the Virtual PlayList 
[0071] The operation for the Virtual PlayList is now explained. If an operation is performed for the Virtual PlayList, 

15 the contents of the Clip are not changed. Figs. 6A and 6B show the assembling and editing (IN-OUT editing). It Is an 
operation of creating Playltem of the playback domain the user has desired to view to create Virtual PlayList. The 
seamless connectbn between Playltems is supported by the application fomnat, as later explained. 
[0072] If there exist two Real PlayLists 1 . 2 and clips 1 . 2 associated with the respective Real PlayLlsts. the user 
specifies a preset donriain in the Real PlayList 1 (domain from INI to QUT1: Playltem 1) as the playbacic domain, and 

^ also specifies, as the domain to be reproduced next, a preset donriain In the Real PlayList 2 (domain from iN2 to 0UT2: 
Playltam 2) as the playback domain, as shown In Flg.6A, a sole Virtual PlayList made up of Playltem 1 and the Playitem2 
Is prepared, as shown In Flg.6B. 

[0073] The re-editing of the Virtual PlayList is now explained The re-edlting may be enumerated by alteration of IN- 
or OUT points in the Virtual Playllist, insertion or appendage of new Playltems to the Virtual PlayList and deletion of 

3 Piayltenw In the Virtual PlayList The Virtual PlayList itself may.a^^^^ 

[0074] Fig.7 shows the audio dgbblng (post recording) to the Virtual PlayList. It Is an operation of registering the 
audio post recording to the Virtual PlayList as a sub path. This audio post recording Is supported by the application 
software. An additional audio stream Is added as a sub path to the AV stream of the main path of the Virtual PlayList. 
[0075] Common to the Real PlayList and the Virtual PlayList is an operation of changing (moving) the playback 

30 sequence of the PlayList shown In Flg.8. This operation is an alteration of the playback sequence of the PlayList In.the 
disc (volume) and Is supported by TableOf PlayUst as defined in the application format, as will be explained subse- 
quently with reference to e.g, , Flg.20, This operation does not lead to alteration of the Clip contents. 
[0076] The mark (Mark) Is now explained. The mark Is provided for specifying a highlight orcharacterlsttetlnw In the 
Clip and In the PlayList, as shown In Flg,9. The mark added to the Clip Is termed the CIlpMark. The CllpMark Is e.g., 

35 B program Indexing point or a scene change point for specifying a characteristic scene ascribable to contents In the 
AV stream. The ClipMark Is generated by e.g.. the analysis unit 14 of Fig.1 . When the PlayList is reproducekl, the nr^ark 
of the Clip referenced by the PlayList nnay be referenced and used. 

[0077] The mark appended to the PlayList Is termed the PlayLlstMark (play list mark). The PlayLlstMark Is e.g., a 
bookmark point or a resuming point as set by the user. The setting of the mark to the Clip and to the PlayList la by 
4tf adding a time stamp Indicating the mark timo point to the mark list. On the other hand, mark doietion Is removing the 
time stamp of the mark from the mark ilst. Consequently, the AV stream Is in no way changed by mark settlr\g or by 
mark daletton. 

[0078] As another romnait of the ClipMark. a picture referenced by the CllpMark may be specified on the address 
. basis In the AV stream. Mark setting on the Clip Is by adding the address basis Information indicating the pteture of the 
45 mark point to the mark list. On the other hand, mark deletion Is removing the address basis Infomiatlon indicating the 
mark jDoInt picture from the mark list. Consequently, the AV stream Is In no way chariged by mark setting or by nnark 
deletion. 

[0079] . A thumbnail Is now explained. The thumbnail Is a still picture added to the Volume, PlayList arid Clip. There 
are two sorts of the thumbnail, one of them being a thumbnail as a representative picture Indicating the contents. This 

50 is mainly used In a main picture in order for the user to select what the or she desired to view on acting on a cursor, 
not shown. Another sort of the thumbnail is a picture Indicating a scene pointed by the mark. 
[0080] The Volume and the respective PlayLists need to own representative pictures. The representative pictures 
of the Volume are presupposed to be used for Initially demonstrating a still ptoture representing the disc contents when 
the disc Is set In position In the recording ahd/or reproducing apparatus 1 . It is noted that the disc means the recording 

55 msdlum 1 00 which Is presupposed to be a of disc shape. The representative picture of the PlayList le presupposed to 
be used as a still ptoture for representing PlayList contents. 
. [0081 J As the representative picture of the PlayList, It may be contemplated to use the Initial pteture of the PlayList 
as the thumbnaH (representative picture). However, the leading picture at the playback time pf 0 is not necessarily an 
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optimurh picture representing the contents. So. the user .18 altowed. to set an optional picture as a thumbnail of the 
PlayList Two sorts of the thumbnails, that is the thumbnail as a representative picture indicating the Volume and the 
thumbnail as a representative picture Indicating PlayList, are ternied menu thumbnails. Since the n>enu thumbnails 
are demonstrated frequently, these thumbnails need to be read out at an elevated speed from the disc;. Thus, it is 

9 efflcteni to store the totality of the menu thumbnails In a sole file. It Is unnecessary for the menu thumbnails to be . 
pictures extracted from the moving pictures in the volume, but may be a picture' captured from a personal computer or 
a digital still camera, as shown in FI9. 10. 

[0082] On the other hand, the Clip and the PlayList need be marked with pluiBlmark^ 

points need to be reacfily viewed In order to grasp the contents of the mark positions. The picture Indicating such mark 

10 polntistenriedamarKthunribnaij.Therefore.thepk^urewhichistheorigih . 
mark point picture rather.than a pbture captured from outside. 

[0083] Fig.11 show^ the relation between the mark affixed to the PlayList and the mark thumbnail, whilst Fig. 12 
shows the relation between the mark affixed to theClip and the mark thumbnail, in distinction from the menu thumbnail, 
the mark thumbnail is used In e.g., a 8ub*nr^nu for representing details of the PlayList, vyhile It Is not requested to be 
IS read out in a short access time. So, whenever a. thumbnail is required, the recording and/or repreducing apparatus 1 
opens a file and reads out a portion of th^ file, while there Is no problem presented even if file opening and reading 
out a portk>n of the file by the recording and^or reproducing apparatus i takes some time. 
[0084] For decreasing the number of files present in a volume, it Is preferred for the totality of the mark thumbnails 
to be stored In one file. While the PlayList may own one menu thumbnail and plural mark thumbnails, the user Is not 
20 required to select the Clip directly (usually, the Clip is selected through PlayList), and hence there Is no necessity o^ 
providing menu thumbnails, , 

[0085] Fig.13 shows the relation between the menu thumbnails, mark thumbnails, PlayList and Clips. In the menu- 
thumbnail inie are filed menu thumbnails provided from one PlayList to Another. In the rtienu thumbnail file Is contained 
a volume thumbnail representing the contents of data recorded on the disc, ih the menu thumbnail file aretited thumb.- 
2S nails created from one PlayList to another and from one Clip to another. 

[0086] The GPI (Characteristic Point Infonnatlon) Is hereinafter explained. The CPI Is data contained In the Clip 
. Inf omnation file and Is used mainly for flndlrig a data address In the Clip AV stream file at whk:h to start the data readout . 
when a tlnhe stamp of the ieiccess point to the Crp is afforded. In the present enr^>odimerU two sorts of the CPI are used, 
one of them being EP_map and the other being TU_map. 
30 [0087] The EP_map is a list of eritry point (EP) data extracted from the elernentary 

This has the address infomiatldn Ujsed to find the site of entry points In the AV stream at which to start the decoding. 
One BP data Is made up of a presentation tlnie stamp (PTS) and a data address In the AV stream of the accessing 
unit associated with the PTS, with the data address being paired to the PTS. 
[0088] TheEP.maplsusedmatniyfor twopurposes. First, It is used forfindlng a data address 
S5 the accessing unit referenced by the PTS In the PlayList. Second, the EP.map Is used for fast forward playback or 
fast reverse playback, if. In recording the Input AV stream by the recording and/or reproducing apparatus 1 , the syntax 
of the stream can be analyzed, the EP_niap is created and recorded on the disc. 

[0089] The TU_map has a list of time unit (TU) data which Is derived from the an'lval time point of the transport packet 
Input through a digital interface. This affords the relatiori between the arrival4ime-based time and the data address in 
40 the AV stream. When the recordirig apd/or reproducing apparatus 1 records an Input AV stream, and the syntax of the 
stream cannot be analyzed, a TU_map Is created and recorded on the disc. 

[0090] The STCInfo istores the discpntinuous point information In the AV stream file which stores the MPEG-2 trans- 
port stream. 

[0091] When the AV stream has.discontiriuous points of STC. the same PTS values may appear In the AV stream 
45 file. Thus, if a time point In the AV stream is specified on the PTS basis . the PTS pf the access point is insufficient to. 
. specify the point. Moreover, an Index of the continuous STC domain containing the PTS is required. In this fonmat. the 
continuous STC domain and ite Index are termed an STC-sequence and STC-sequence-fd, respectiveiy. The STC- 
sequence information Is defined by the STCInfo of the Clip Infomiatlon file. 

[0092] The STC-sequenceHd Is used In an AV stream file and Is optional In the AV strearn file having the TU„map. 
so [0093] The programs are each a collectk>n of elementary streams and co-own a sole system time base for sy^ 
nized reproductbn of these streams. 

[0094] It is useful for a reproducing apparatus (recording and/or reproducing apparatus 1 of Rg. 1) to know the 
contents of an AV stream prior to Its decoding. These contents include e.g., values of the PID of a transport packet 
transmitting an audio or video elementary stream or the type of the video or audio components, such as HDTV video 
S9 or MPEG-2 AAC audio stream. This information is useful for creating a menu screen toy illustrating to the user the 
contents of the PlayList referencing the AV stream. It Is similarly useful for seittlng the initial state of the AV decoder 
and the demultiplexer of the respective a|3|3aratus. 

[0095] Forthis reason, tiie Clip information file owns Programlnfo for Illustrating the 
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[0096] It may be an occurrenca that program contents be changed In the AV stream file In which the MPEG-2 transport 
stream. Is stored.. For example, the PID of the transport packet transmitting the video elementary stream may be ' 
changed, or the component type of the video stream may be changed from SOTV to HDTV. 
[0097] The Programlnfo stores the Infomnation on change points of program contents In the AV stream file. The 
s domain of the AV stream file In which the program contents remain constant Is termed program-sequence. 

[0098] This program-sequence is used In an AV stream file having EP.map and Is optional in an AV stream file 
having TU_map. 

[0099] The present embodiment defines the self-encoding stream forrnat (SE8F). The SESF is used for encoding 
analog Input signals and for decoding digital input signals for subsequently encoding the decoded signal into an MPEG- 
2 transport stream. 

[01 00] The SESF defines an elementary stream pertinent to the MPEG-2 transport stream and the AV stream. When 
the recording and/or reproducing apparatus 1 encodes and recoifds input signals in the SESF» an EP.map is created 
and recorded on the disc. 

[0101] A digital broadcast stream uses one of the following systems for recording on the recording medium 100: 
IS First, the digital broadcast stream is transcoded Into an SESF stream. In this case, the recorded stream must confomn 
to SESF and EP_map must be prepared and recorded on the disc. 

[0102] Alternatively, an elementary stream forming a digital bmadcast stream Is transcoded to a hew elenientary 
stream and re-multiplexed to a new transport stream conforming to the stream format prescribed by the organization 
for standardizing the digital broadcast stream. In this case, an EP.map must be created and recorded on the disc. 
^ [0103] For example, it is assumed that the input stream Is an MPEG-2 transport stream conforming to the iSDB 
. (standard appellation of digital BS of Japan), with the transport stream containing the HDTV video stream and the 
MPEG AAC audio stream. The HDTV video stream is transcoded to an SDTV video stream, which SDTV video stream 
and the original AAC audio stream are re-multiplexed to TS. The SDTV stream and die transport stream both need to 
conform to the iSDB format. 

^ - [0104] Another system of recording the digital broadcast stream on the recording medium 1 0O Is to make transparent 
recording of the Input transport stream, that is to record the Input transport stream unchanged, In which case the 
EP.map is fomiulated and recorded on the disc. 

[0105] Aitematlvoly, the input transport stream is recon:led transparently, that Is an input transport stream is recorded 
unchanged, in which case TU_map is created and recorded on the disc. 

^ P106] The directory and the file are hereinafter explained. The recording and/or reproducing apparatus 1 is herein- 
after described as DVR (digital vfdeo recording). Fig.1 4 shows a typical directory structure on the disc. The directories 
of the disc of the DVR may be enumerated by a root directory including "DVR" directory, and the "DVR" directory, 
including -PljAYLIsr directory, "CLIPINF" directory, "M2TS" directory and "DATA" directory, as shown In Rg.14. Al- 
though directories other than these may be created below the root directory, these are discounted In the application 

^ format of the present embodiment. 

[0107] Below the "DATA'* directory, there are stored all flies and directories prescribed by the DVR application fomiat. 
The "DVR" directory Includes four directories. Below the "PLAYLIST" directory are placed Real PlayLlst and Virtual 
PlayList database files. The latter directory may exist In a state devoid of PlayLlst. 

[0108] Below "CLIPINP is placed a Clip database. This directory, too, may exist in a state devoid of AV stream files. 

^ In the "DATA" directory, there are stored files of data broadcast, such as digital TV broadcast. 

[0109] The "DVR" directory stores the following files: That is, an "Info.dvr" is created below the DVR directory to store 
the comprehensive Infonnation of ansapplicatlon layer. Below the DVR directory, there must be a sole Info.dvr, The 
filename is assumed to be fixed to info.dvr, The "menu.thmb" stores the infonr^ation pertinent to the menu thumbnails. 
Below the DVR directory, there must be 0 or 1 mari< thumbnail. The filename is assumed to be fixed to "menu.thmb". 

45 If there Is no menu thumbnail, this file may not exist. 

[01 1 0] The "marfc.thmb' file stores the Information pertinent to the mark thumbnail picture. Below the DVR directory, 
there must be 0 or 1 nrwk thunr^nail. The filename is assumed to be fixed to "menu-thmb". If there Is no menu thumbnan, 
this file may not exist. 

[0111 J The "PLAYLIST* directory stores two sorts of the PlayLlst files which are Real PlayLlst and Virtual PlayList. 
so An "xxxxx.rpis" file stores the infonmatloh pertinent to one Real PiayUst. One file Is created fpr each Real PlayList. The 
filename Is "xxxxx.rpis", whe^e "xxxxx" denotes five numerical figures from 0 to 9. A file extendermu^t be "ipls". 
[0112] The Vyyyy vpls" stores the Infonmatlon pertinent to one Virtual PlayList. One file with a filename 'Wyyy.vpls' 
is aeatedfrom one Virtual PlayList to another, where *'yyyyy" denotes ih/e numerical figures from 0 to 9. A file extender 
must be "vpis". 

» [0113] The "CLIPINF" directory stores one file in association with each AV stream file. The "zzzzz.clpi" is a Clip 
Information file corresponding to one AV streani file (Clip AV stream file or Bridge-Clip stream file). The filename is., 
"zzzzz-clpi", where "zzziz" denotes five numerical figures from 0 to 9. A file extender must be "dpi". 
[01 14] The "M2TS" directory stores an AV stream fHe. The "2zzzz.m2t8".flie is an AV stream file handled by the DVR 
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system. TWs is a Clip AV stream file or a Bridge-Clip AV stream file. The fliename Is "zzzzz.m2t8'\ where "zzzzz" 
denotes five numerical figures from 6 to 9. A file extender must be 'mats". 

[0115] The "DATA" directory stores data transmitted .from data broadcasting. This data may, for example, be XML 
or MPEG files, 

[01 1 6] The syntax and the semantics of each directory (file) are now explained. Fig. 1 5 shows the syntax of the "Info.. 
dvr*file. The 'Info.dvr^ file is made up of three objects, that is DVRVoume(), TableOfPlayLlstsQ and MakersPrivateData 

•().'•■•. 

[0117] Thesyntax of info.dvr shown In Rg.16 is explained. TheTableOfPlayLlsts^Startjddress Indicates the leading 
address of the TableOfPlaylJsts() In temis of the relative number ofbytes from the.leading byte of the "irifo.dvr* fite. 
The relative number of bytes Is counted beginning from o! 

[0118] The MakersPrivateData_Start_address Indicates the leading address of the MakersPrlvateDataO, In terms 
of the relative number of bytee as from the leading byte of the "info.dvr* file. The relative number of bytes Is counted 
from 0. The paddlng^word is iriserted in. association witii the syntax of "Info.dvr". N1 and N2 are optional positive 
Integers. Each padding word may assUme an optional value. 

[0119] The DVRVolumeO stores the information stating the contents of the volume (disc), Flg,1 6 shows the syntax 
of the DVRVolunie. The syntax of the DVRVolume(), shown In Flg.1 6, Is now explained. The verslon_niimber indicates, 
four character letters indicting the version numbers of the bVRVolume().. The version.number is encoded to "0045' in 
Bssoqiatlbn vsrith IS0646. 

[0120] Length ^ denoted by 32-blt unsigned Jntegeris Ihdtoating the number of bytes from cQrectly after the length 
field to the trailing end of DVRVolume(). 

[0121] The ResumeVolume() memorizes the fliename of the Real PiayLlst or the Virtual PlayList reproduced last In 
the Volume. However, the piai^aek position when the user has inleniipted playb^^ Real PlayList or the Virtual 
PlayList Is stored in the resume-rriarlc defined in the PlayLlstMarkQ (see Fig8.42 and 43). 

[0122] Rg,17 shows the syntax of the ResumeVolumeQ. The syntax of the ResumeVolume() shown In Fig.17 is 
explained. Tlie valid Jlag indteetes that the re8ume_PlayLlst_name field Is valid or invalid when mis l'-blt flag Is set to 
1 orO, respeptively. 

[0123] The 1Q-byte flekJ of resumeiPiayList^name indicates the fllehame of the Real PlayList or the Virtual PlayList 
to be resumed. ■ 
[0124] The UlApplnfoVolume in the syntax of the DVRVoiumeO» shown In Fig.16» stores parametidrs of the user 
iriterface application oonceming the Volume; . Fig. 18 shows the syntax of the UlApplnfoVolume, the semaiittes of which 
are now explained. The 8-bit field of character.set indicates trie encoding method for character letters encoded In the 
Volume_name field. The encoding method con-esponds to the values shown In Fig. 19. 

[01 25] The 8-blt field of thenarnejength Indicates the byte length of the Volume name indteated in the Volume^name 
field. The Volunwf^name field tndk^ates the appeilation of the Volume. The number of bytes of the number of the^ 
namejength counted from left of the fiekJ Is the number of valid characters and indicates the volume appellation. The 
values next following these valid character letters may be any values. /. 

pi 26] The Volume jDrotect Jag is a flag Indicating whether or not the contents in the Volume can be shown to the 
user without limitations.* If this fiag Is set to 1 , the contents of the Volume are allowed to be presented (reproduced) to 
the user only In case the user has succeeded In correctly inputting. the PIN number (password). If this flag Is set to 0, 
the contents of the Volume are altowed to be presented to the user even In case the PIN nunriber Is not Input by the user. 
pi27] If, vyhen the user ha^ Inserted a disc Into a player, this flag has been set to 6. or the flag Is set to 1 but the 
user has succeeded InconBCtly iriputting the PIN number, the recording and/or reproducing apparatus 1 demonstrates 
a list of the PlayList In. the disc. The limitations on reproduction of the respective PlayLists are inrelevant to.the 
Volume jjrotect Jlag and are indicated by playback^controlj lag defined in the UlApplnfoVolume. 
[0128] The PIN is made up of four numerical figures of from 0 to 9, each of which is.coded in accordance with ISO/ 
lEC 646. The ref.thumbnaiUndex field indicates the jnfonnatlon of a thumbnail pk:ture added to the Volume. If the 
ref jhiimbnaiUndex. field Is of a value other than OxFFFR a thumbnail pcture is added to the Volume. The thumbnail 
picture Is stored in a menu.thiirrib hie. The picture is referenced using the value of the refjhumbnalljndex in the menu! 
thumb file, if the ref _thumbnalljndex field is OxFFFF, it indicates that a thumbnail picture has been added to the Volume. 
[0129] The TableOfPiayListO in the Info.dvr syntax shown In Flg.16 is explained. The-TabIeOfPlayUsl() stores the 
fliename of the PlayList (Real PlayList and Virtual PlayList). All PlayList files recorded in the Volume are contained In 
the TableOfPlayListp. which TabieOfPiayLlst() Indicates the playbacic sequence of the default of the PlayList In the 
Volurpo. 

[0130] Fig.20 shows ttie syntax of the TableOfPiayListO, which is now explained.. The version.number of the Tabfe- 
OfPiayListO Indicates four character letters fridlcating the version numbers of the TableOfPlayLlsts. The 
verslon_nuniber must be encoded to "0045" in accordance with. ISO 646. 

[0131] Length Is a unsigned 32-bit integer indicating the number of bytes of the.TableOfPlayLlstQ from directly after 
the length field to the tmlling end of the TableOfPiayListO. The 16-bit field of the number.of.PiayLlsts indicates the 



EP1 198133A1 

number of loops of the for-loop inclusive of the PlayLisUile^name, This numerical figure must be equal to the nunnber 
of PlayLlsts recorded in the Volume. The 10-byte numerical figure of the PlayListJIIe^hame indicates the filename of 
the PlayLlsts. 

10132] Flg.21 shows another configuration ofthe syntax of theTableOf PiayLl8t(), The syntax shown In Flg.21 is com- 
5 prised of the syntax shown In Flg.20 In which Is contained the UlApplnfoPlayLlst. By such structure Including the 
UlApplnfoPlayLlst, It becomes possible to create a menu picture simply on reading out the TableOfPlayLlsts. The 
following explanation is premised on the use of the syntax shown In Fig.20. 

[0133] The MakersPrlvateData In the Info.dvr shown in Flg.16 Is explained. The MakersPrlvateData Is provided to 
permit the maker of the recording and/or reproducing apparatus 1 to Insert private data of the maker in the MakersPrl- 

10 vateDataO for special applications of different companies. The private data of each maker has standardized maker.lD 
for identifying the maker who has defined it. The MakorsPiivatoDataO may contain one or more makerJD. 
[01 34] If a preset maker Intends to insert private data, and the private data of a different maker la already contained 
In the MakersPrlvateDataOi the new private data Is added to the MakersPrlvateDataO without erasing the prensxlsting 
old private data. Thus, In the present embodiment, private data of plural makers can be conlainad In one MakersPrl- 

15 vateData(). 

[0135] Fig.22 shows the syntax of the Makers PrivateData. The syntax of the MakersPrlvateData shown In Flg.22 Is 
explained. The verslon.number of the TableOf PlayLlstQ Indicates four character letters Indteating the versksn numbers 
of the TableOfPlayLlsts. The version^n umber must be encpded to "0045* in accordance with ISO 646. Length Is a 
unsigned 32-bit integer indicating the number of bytes ofthe TableOfPlayList() from directly afterthe length field to the 
trailing end of the MakersPrlvateDataO. 

[01 36] The mpd_blocks_starLaddrB8s Indicates the leading end address of the first mpd^blockO in tenns of the 
relative number of bytes from the leading byte of the MakersPrlvateDataO. The number^of^maker_.entrle8 is the 1 6-blt 
codeiess integer affording the number of entries of the maker private data Included In the MakersPrivateData(). There 
must not be present two or more maker private data having the same meker.lD values In the Makers PrivateDataQ. 
[0137] The mpd.blocks.size is a 1 6-blt unsigned integer affording one mpd.block size in terms of 1 024 bytes as a 
unit. For example, if mpd_block_size = 1, it. Indksates that the size of one mpd^biock is 1024 bytes. The 
number_of_mpd_^block8 Is a 1 6-blt unsigned integer affording the number of mpd^biocks contained In the MakersPri- 
vateDataO. The maker^lD Is the 1 6-bit unsigned Integer Indicating the model number code of the DVR systenrv which 
has created the maker private data. The value encoded to the maker.lD is specified by the licensor. 
[0138] The maker^modeLcode Is a 16-bit unsigned Integer indbating the model number code of the DVR system 
which has created the maker private data. The value encoded to the maker^modei^code is set by the maker who has 
received the license of the fomnat. The start_mpd_block_number is a 1 6-bit unsigned Integer indicating the number of 
the mpd.biock number at which begins the maker private data. The leading end of the maker private data must be 
aligned with the leading end of the mpd_biock. The start„mpd_biock,number corresponds to a variable J in the for- 
loop of the mpd_block. 

[0139] The mpdjength is a 32-blt unsigned integer Indtoating the size of the maker private data. The mpd.block Is 
an area in which is stored maker private data. All of the mpd^blocks In the MakersPrivateDataQ must be of the same 
size. 

[0140] The real PlayLlst file and the Virtual PlayLlst Ale, in other words, xxxxx.rpis and yyyyy.vpis, are explained. 
Rg.23 shows the syntax of xxxxx.rpis (Real PlayLlst) and yyyyy.vpis (Virtual Playlj-let), which are of the same syntax 
structure. Each of the xxxxx.rpis and yyyyy.vpis Is made up of three objects, that, is PlayUstO, PlayLlstMaric() and 
MakersPrivaleDataQ. 

[0141] The PlayLi8tMark_Start_addres6 Indicates the leading address of the PlayListMarkO» In temis of the relative • 
number of bytes from the leading end of the PlayLlst flie as a unit. The relative number of bytes Is counted from zero. 
[0142] The MakerePrlvateData^Start^address Indicates the leading address of the MakersPrivateDataQ, in terms 
of the relative number of bytes from the leading end of the PlayLlst file as a unit. The relative number of bytes Is counted 
from zero. ' . 

[0143] The padding^word (padding word) Is Inserted In accordance with the syntax of the PlayLlst file, with N1 and 
N2 being optional positive Integers. Each padding word may assume an optional value. 

[0144] PlayLlst v^tl be further explained In the toHowIng although It has been explained briefly. A playback domain 
in ail Clips except Bridge-Clip must be refen-ed by all PlayLlsts In the disc. Also, two or more Real PlayLlsts must not 
overiap the playback domains shown by their Piayitems In the same Clip, 

[0145] Reference Is made to Flgs.24A, 24B and 24C. For all Clips, there extst corresponding Real PlayLlsts, as 
shown in Fig.24A. This rule is observed even after the editing operation has come to a close, as shown In Fig.24B. 
Therefore, all Clips must be viewed by referencing one pf Real PlayLlsts. 

[0146] Refen-lng to Flg.24C, the playback domaln.of the Virtual PlayLlst must be contained In the playback domain 
and in the Bridge-Clip playback domain. There must not be present In the disc Brldge*Ciip not referenced by any Virtual 
PlayLlst. 
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P147] The Real PlayUet, containing the list of the Playltem, must not contain SubPiayltem. The! Virtual PlayUet 
contelfiB the Playltenn list and. If the CPLtype contained in the PlayLlstO is the EP_map type and the PlayLlst_.type is 
0 (PiayLlst containing video and audio) , the Virtual PlayUst may contain one SubPiayltem. In the PiayList() in the 
present embodiment, the SubPiayltem is used only for audio post recording. The number of the SubPlayltems owned 

9 by one Virtual PiayLlst must be 0 or 1 . . 

[01481 The PiayLlst is hereinafter explained. Fig.25 sliows the PiayLlst syntax which is now explained. The 
ver6ion_number indicates four character letters Indicting the version numbers of the PlayList(). The version^n umber 
is encoded to "0045" in association with ISO 646. Lengtli Is a 32-bit unsigned integer indicating the total number of 
byte of the PlayList() from directly after the length field to the trailing end of the PlayUstQ. The PlayUst^type, one 

10 example of which Is shown in Flg.26,ls.an 8-blt field indicating the PiayLlst type. 

[0149] The CPl.type Is one^bit flag indicating the value of the CPIJype of the Clip referenced by the Playltem() and 
, by the 8ubPlayltem(). The CPl.types defined in the CPis of all Clips referenced by one PiayLlst must be of the sarne. 
values. The number_of_PI ay Items is a 16-blt field indicating the number of Ptayltems present in the PlayList. 
[0160] The Playltem Jd corresponding to Xhe preset PlayltemQ is defined by the sequence in which the PlayltemO 
15 appears in the for-loop containing the PlayltemO- The Playftemjd begins with 0. The nimber_oLSubPlayitems is a 
16-bIt field indicating the nurhber of SubPiayltem in the PlayList. This value te 0 or 1 . An additional audio stream path 
(audio stream path) is a sort of a sub path. 

[0151] The UlApplnfoPlayUst of the PiayLlst syntax shown in Flg.25 is explained. The UlApplnfoPlayList stores 
parameters of the user interface application concerning the PlayUst. Rg^T shows the syntax of the UlApp Inf oPIayList, 

^ which Is now explained. The character.set is an 8-bit field indicating the method for encoding character letters encoded 
in the PlayList.name Held. The encoding method conresponds to the values conforming to the table shown in Rg.19. 
[0152] Thenamejength IsahB-bitfield indicating the byte length olthe PlayList name indicated in the PlayList.name 
field. The PlayList.name frek) shows the appellation of the PlayUst. The number of bytes of the number of the 
namejength counted from left of the field Is the number of valid characters and indicates \\\$ PlayUst appellation. The . 

25 values next following these valid character letters may be any values. 

[0153] The record Jim e^and^date is a 56-bit field storing the date andtlme on which the PiayLlst was recorded. This 
field is 14 numerical figures for year/ month/ day/ hourAninute/ second encoded in binary coded decimal (BCD). For 
example, 2001/12/23:01 :02:03 is encoded to "0x20011223010203". 

[0154] The duration is a 24-bit field indicating the total replay time of the PlayList In tenms of hour/ minute/ second 
30 as a unit. This field is six numerical figur^es encoded In binary coded dedmal (BCD). For example, 01 :45:30 is encoded 
to "0x014530". 

10155] The validjDeriod Is a 32'blt field Indicating the valid time periods of the PiayLlst. This field is 8 numerical 
figures encoded In 4-btt binary coded decimal (BCD). The valid _period Is used in the recording and/or reproducing 
apparatus 1 e.g., when the PlayList, for which the valid period has lapsed, Is to be automatically erased. For example, 

S5 2001/05/07 Is encoded to "0x20010507*'. 

[0156] The maker JD Is a 16-bit unsigned integer Indicating the maker of the DVR player (recording and/or repro- 
ducing apparatus 1 ) which has been the last to update its PlayList. The value encoded to maker.lD is assigned to the 
licensor of the DVR fonnat. The maker^code is a 16-bit unsigned integer indicating the model number of the DVR 
player whioh has been the last to update the PlayList. The value encoded to the maker.code Is detenmined by the 

40 maker who has reoeh^ed the license of the DVR fonmat. 

[0167] If the flag of the playback.oontroljlag is set to 1 , Its PlayList Is reproduced only when the user successfully 
entered the PIN number. If this flag is set to 0, the user may view the PlayList without the necessity of inputting the 
PIN number. 

[0158] If the write_protectJlag is set to 1, the contents of the PlayList are not erased nor changed except the 
^ write jsrotectjiag. If this flag is set to 0,. the user Is free to erase or change the PlayList. If this flag is set to 1 , the. 
recording and/or reproducing apparatus 1 demonstrates a message requesting re-confirmation by the user before the 
user proceeds to erase, edit or overwrite the PlayList. 

[0159] The Real PiayLlst, In which the wrile_protectJlag is set to 0, may exist, the Virtual PiayLlst, referencing the 
Clip of the Real PlayList may exist, and the wrlte_protecL_flag of the Virtual PlayUst may be set to 1. If the user Is 
so desirous to erase the Real PiayLlst, the recording and/or reproducing apparatus 1 Issues an alarm to the user as to 
the presence of the aforementfoned Virtual PlayList or "minimizes" the Real PlayUst before erasing the Real PlayList. 
[0160] If Is ^played Jlag Is set to 1 . as shown in Fig.28B, It indteates that the PlayList was reproduced at least once 
since It was recorded, ^A^ereas, If It is set to 0, it indicates that the PlayList was not reproduced even once since it was 
recorded. 

ss [0161] Archive Is a two-bh field indicating whether the PlayList is an original or a copy, as shown in Fig.28C. The 
field of ref.thumbnailjndex Indicates the infomiation of a thumbnail ptoture representath^e of the PlayList If the 
ref.thumbnalljndex field is of a value other than OxFFFF, a thumbnail picture representative of the PlayList is added 
in the PiayLlst, with the PiayLlst being st^n^ed in the menu.thnnb file. The picture Is referenced using the value of 
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refjhumbnalljndex In the menu.thmb file. If the refjhumbnalljndex field Is OxFFFF. no thumbnail picture repreeent- 
atlve of the PlayList is added In the PlayLlet. 

[0162] The Playltem Is hereinafter explained. One Pleyltem() basically contains the following data: 
Clipjnfonnation Jile.name for specifying the filename of the Clip, IN-tlme and Oirrtlme, paired together to specify 
9 the playback domain of Clip, STC.sequenceJd referenced by IN*tlme and OUT-tlme In case the CPl.type defined In 
PlayLlslO Is EP^map type, and Connectlon^Condltion Indicating the connection condition of previous Playltem and 
current Playitem. 

[0163] If PlayList Is made up of two or more Play Items, these Playltems are an-ayed In a row, without temporal gap 
or overlap, on the global time axis of the PlayUst. if CPI^type defined In the PlayList is EP^map type and the current 

w PlayList does not have the BrldgeSequence(>, the.lN-tlme and OUT-tlme pair must Indicate the same time on the STC 
continuous domain as that specified by the STC.sequonco.ld. Such Instance Is shown in Fig.29. 
[0164] Fig.30 shows such a case In which the CPLtypo defined by PlayLlst() and, If the current Playltem has the 
BridgeSequenceO, the rules as now explained are applied, The IN^time of the Playltem previous to the current Play- 
ltem, shown as IN Jlmel , Indicates the time in BridgerCIlp specified In the BridgeSequenceinfoO of the current Play- 

f^ Item. This OUTjlme must obey the encoding ilmltatlons which will be explained subsequently. 

[0165] The IN_tlme of the current Playltem, shown as lNJIme2, Indicates the time In Bridge-Clip specified In the 
BridgeSequenceinfoO of the current Playltem. This IN.tlme also must obey ths encoding limitations as later explained. 
The OUTjlme of Playltem of the cun-ent Playltem, shown as 0UT_time2. Indicates the time on the STC continuous 
domain specified by STCsequenbceJd of the current Piaylteni. 

so pi66) If the CPLtype of PlayListO is TU^map type, the IN Jme and OLTT JIme of Playltem, paired together, Indicate 
the time on the same Clio AV stream, as shown In Flg.31 . 

[0167] The Playltem syntax Is as shown In Flg.32. As to the syntax of the Playltem, shown in Flg.32. the field of the 
Cllpjnf omiatlon Jle_name indicates the filename of the Clip Information. The Clip^stream Jype defined by the Gllplnfo 
0 of this Clip infonnatlon file must indicate the Clip AV etream. 
S5 [0168] The STC.sequenceJd is an 8-bit field and Indicates the STC.eequenceJd of the continuous STC domain 
referenced by the Playltem. If the CPI^type specified In the PlayListO ^ TU_map type, this 8-blt field has no meaning 
and is set to 0. INJime is a 32-bit field and used to store the playback start time of Playltem. The semantics of IN Jime 
differs with CPLtype defined in the PlayListOt as shown in Fig.33. 

[01 66] OUTjime is a 32-bit field and Is used to store the playback end time of Playltem. The semantics of OUT Jime 
so differs with CPLtype defined in the PlayListO, 8e shown In Ftg.34. 

[0170] Connection.conditlon is a 2-bit field Indicating the connection condition between the previous Playltem and 
the current Playltem, as shown In Fig.35. Figs.36A to 36D illustrate various states of Connectlon.condition shown In 
Flg.36. 

[0171] BrldgeSequencelnfo Is explained with reference to Flg.37. This BrIdgeSequencelnfo Is the ancillary Infonr^a- 
^ tlon of the current Playltem and includes the following information. That Is, BrldgeSequencelnfo includes 
9ridge_CllpJnformation_file_name for specifying the BridgerCIlp AV file and a Bridge_Cllp_lnfomiatlon_flle_name 
specifying the corresponding Clip information file (Flg.46). 

[0172] It is also an address of a source packet on the Cl^ AV stream referenced by the previous Playltem. Next to 
this source packet Is connected the first source packet of the Bridge-Clip AV stream. This address is tenned the 
40 RSPN_exlLfrom^revlou8_Cllp. It Is also an address of the source packet on the Clip AV stream referencisd by the 
cumsnt Playltem. Ahead of this source packet is connected the last source packet of the Bridge^cllp AV stream file. 
This address Is temied RSPN_enterJo_currenLCIip. 

[0173] In Rg.37, RSPN_arr1valJlme_dIscontlnulty Indicates an address of a source packet In the Brldge.Cilp AV 
stream whera there Is a discontinuous point In the an-ival time base. This address Is defined In the Cllplnfo() (Flg.46). 
^ [0174] Fig.38 shows the syntax of the BrldgeSequencelnfo. Tuming to the syntax of BrldgeSequencelnfo shown in 
Flg.36, the fiekl of Brldge.CllpJnfomiatlon.flie.name indk»tes the filename of the Clip InfomnationfiieconBsppnding 
to the Br1dge.Clip.lnfomiatk>n_flle. The CHp.stream.type defined In CliplnfbO of this Clip Infonnatlon file must Indicate 
'Bridge.ClipAV stream'. 

[0175] The 32-blt field of the RSPN.exiLfromjsrevious^Cllp is a relative address of a source packet on the Clip AV 
so stream referenced by the prevbus Playltem. Next to this source packet is connected the first source packet of the 
BrIdge.Clip AV stream file. The RSPN.exIt JronLprevious.Cilp has a size based on the source packet number as a 
unit, and Is counted with the value of the offset.SPN defined in the CliplnfoO from the first source packet of the Clip 
AV stream file referenced by the previous Playltem. 

[0176] The 32-blt field of RSPN.enter.to.curent.Cllp Is the relative address of the source packet on the Clip AV 
ss stream referenced by the current Playltem. Ahead of this source packet is connected the last source packet of the 
8rldge.Cllp.AV stream file. The RSPN_enterjo.curent.Cllp has a size that Is based on the source packet nunr^er 
as a unit. The RSPN.entorJo_curent_Ciip is counted witii the value of the offsel^SPN, defined in the CliplnfoO '^m 
the first source packet of the Clip AV stream file referenced by the cun^ent Playltem, as an Initial value. 
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1[0177J The SubPIayltem is explained with reference to Flg.39. The use of .SubPlayltem() is permitted only If the 
CPLtype of the PlayLlstO Is the EP_map. type. In the present embodiment. SubPIayltem Is used only for audio post 
recording. The SubPlayltem() includes the following data. First, ll lncludes Clip^lnfonnriatlonjile^name for specifying 
1 the Clip referenced by the sub path In the PlayList 

j s [0178] It also Includes SubPath_IN_tlme and SubPath_OUT_tlme for specifying the sub path playbacit domain In 
the Clip. Additionally, It Includes sync_PlayltemJd and start_PtS_of_Playltem for specifying the time of starting the 
sub path reproduction on the main path time axis. The Clip AV streanri, referenced by the sub path, must not contain 
SJC discontinuous points (discontinuous points of the system time base). The cloclcs of audio samples of the Clip used 
In the sub path are locked to the clocl(s of the audio samples of the main path. 
io [0179] Rg,40 shows the syntax of the SubPIayltem. Turning to the syntax of the SubPIayltem. shown In Fig.40, the 
field of the Clip^lnfonfnatbn.file.nanfie Indicates the filename of the Clip Information file and Is used by a sub path In 
. the PlayLfet. The Clip_8tream_type defined in this CDplnfoO must Indicate the Clip AY stream. 

{0180) An 8*lt field.of sync_PlayltemJd indicates the sub path type. Here, only '0x00' Is set, as shown in Flg.41 , 
i while other values are reserved for future use. 

i [01811 The 8-bltfleld of sync_PlayltemJd indicates the Piayltemjd of the Playltem containing the time of playback 

\ start of the s ub path on the time axis of the main path . The value of Piayltemjd corresponding to the. preset Playltem 

\. Is defined in the PlayUstO (Fig.25). 

PIMI A 32-blt field of 8ync_start_PTS_of_Rlayltem denotes the time of playback start of the sub.path on the tinrie 



I axis of the main path, and denotes the upper 32 bits of the PTS (presentation time stamp) on the Playltem riaferenced 
J 20 by the sync_Playltemiid. The upper 32 bit field of the SubPath^lNjime stores the playback start time of the sub path. 
I SubPathJNJme denotes upper 32 bits of the PTS of 33 bits corresponding to the first presentation unit in the sub path. ' 

[0183] The upper 32 bitfield of subPath.OUT_tlme stores the playback end time of the sub path. SubPath^OUTJme 
I Indicates upper 32 bits of the value of the Presentation^end.TS calculated by the following equation: 

\ 25 

I • Presentation„end_TS = PTS_OUT AU.duratlon 

i ... * ' . • 

5 where PTS.out is the PTS of the 33 bit length corresponding to the last presentation unit of the SubPath and 

AU.duration is the .90 klHz based display period of the last presentation unit of the SubPath. 
30 [OIMJ Next, PiayUstMarkO In the syntax of xxxxx.rpis and yyyyy.vpis shown in Flg53 is explained. The mark infor- 
mation pertinent to the PlayList Is stored In this PlayUstMark. Fig.42 shows the syntax of PiayLlstMark. Tuming to the 
syntax of the PlayUstMart< shown In Flg.42, varsion_n umber is four character letters Indicating the version number of 
k this PlayLlstMark(). The version^number must be encoded to "0046" In accordance with ISO 646, 

I [0185] Length Is an unsigned 32-bit integer lndk:ating the number of bytes of PlayLlstMark() from directly after the 

I ^ length field to the trailing end of the PlayLlstMarkQ. the number.of.PlayListMarks is a 1 6-blt unsigned integer indicating 
j ttie number of marks stored in the PiayLlstMark. The number_of_PlayLlstMarks may be zero. The mark_type is an 

\ 8-bll field Indicating the mark type and is encoded in the table shown in Fig.43. 

I [0188J A 32-bit filed of marietirrie.stamp stores a time stamp Indfcating the point specified by the mark. The soman- 

I ttes of the markjme_8tamp differ with CPiJype defined in the PlayLlst(), as shown in Rg.44. The Playltenijd is an 

1 ^ 8-bit field specifying the Rayltem where the mark is put. The Values of Playlteim Jd corresponding to a preset Playltem 
j is defined In the PlayListQ (see Fig.25). 

I [0187] An 8-blt field of character^set shows the eincoding method of oharacter letters encoded in the mark_name 

\ field. The encoding method corresponds to values shown In Fig. 19. The 8-bit field of naniejength indicates the byte 

I length of the mark name shown in the mark^name field. The mark_name field denotes the mark name indicated Iri the 

\ 45 mark.name field. The number of bytes corresponding to the number of namejengths from left of this field is the 
j effective character letters and denotes the nnark name, in the mark^nanie field, the value next following these effective 

( character letters may be arbitrary. 

I [0188] The fi&ld of the refjhumbnaiijndex denotes the infonnatlon of the thumbnail picture added to the mark. If 

I the field of the refjhumbnaiijndex is not OxFFFF, a thumbnail picture is added to its mark, with the thumbnail picture 

\ so being stored In the mark.thmb file. This pteture Is referenced in the mark;thmb file, using the value of 
[ ref^thumbnaiUndex, as explained subsequently. If thfo refjhumbnaiijndex field is OxFFFF, It Indicates that no thumb- 
\ nail picture is added to the mark. 

• [0189] The Clip Infomiation file is now explained. The zzzzz.clpi (Clip Infomiation file) Is made up of six objects, as 

shown In Rg.45. These are Cilplnfo(), STCJnfpO, Program(),.CPi(), CiipMarkQ and ISrtakersPrivateDataO. For the AV 
I ^ stream (Clip AV stream or Bridge^lip AV stream) and the corresponding Clip Infonnation file, the same string of nu- 
merals "zzzzz" is used. 

[0190] Tuming to the syntax of zzzzz.clpi (Clip Infomiation file) shown in Fig.45 is explained. The 
Clip]nfo.StartL.address Indicates the leading end address of CiiplnfoQ with the relative number of bytes from the leading 



• [ • . ' " ^ ■ 17- 

» 

BNS 3CID:<E P . naaiaaAi i >' 



EP1 198 133A1 



end byte of the zzzzz.clpl file as a unit. The relative number of bytes Is counted from zero. 
[0191] The STC_lnfo.Start_aGldres6 Indicates the leading end address of STC:.lnfo with the relative number of bytes 
from the leading end byte of the zzzzz.clpl file as a unit. The Programlnfo.Start^ddress Indicates the leading end 
address of Programlnfo{) with the relative number of bytes from the leading end byte of the zzzzz.clpl file as a unit. 
5 The relative number of bytes Is.counted from 0. The CPLStait_address Indicates the leading end address of CPIQ 
with the relative number of bytes from the leading end byte of the zzzzz.clpl file as a unit. The relative number of bytes 
is counted from zero. 

. [0192] TheCllpMarK_StarUaddre88 indicates the leading end address of CllpMar1(() with the relative number of bytes 
from the leading end byte of the zzzzz.clpl file as a unit. The relative number of bytes is counted from zero. 

10 The.MakersPrivateDate Star^address Indicates the leading end address of MakersPrlvateDataO with the relative 
number of bytes from the leading end byte of the zzzzz.clpl file as a unit. The relative number of bytes is counted from 
zero. The paddlng_word is inserted in acoordanoo with the syntax of the zzzzzxipi file. N1 , N2, N3» NI4 and N6 must 
be zero or optional positive Integers. The reepectlve padding words may also assume optional values. 
[0193] The Cliplnfo Is now explained. Flg.46 shows the syntax of Cllplnfo. Flg.46 shows the syntax. of Cllplnfo. In 

15 the ClipinfoQ Is stored the attribute Infomiatloh of corresponding AV stream files (Clip AV stream or Brldge-CDp AV 
stream file). 

[0194] Turning to the syntax of the Cllplnfo shown In Fig.46, version.riumber is the four character letters indicating 
the version number of this CllplnfoO. The verslon^number must be encoded to "0045" in accordance with the ISO 646. 
Length Is a 32-blt unsigned Integer Indicating the number of bytes of CiiplnfoO from directly at back of the length field 
20 to the trailing end of the Ciiptnf o(). An 6-bit field of Clip.stream.type Indicates the type of the AV stream corresponding 
to the Clip Infonmatlon file, as shown In Fig.47. The stream types of the respective AV streams wilt be explained sub- 
sequently 

[0195] The 32-blt field of offset_SPN gh^es an offset value of the source packet number of the first source pacfket 
number of thefirst source packet of the AV stream (Clip AV stream or the Bridge-Clip AV stream). When the AV stream 

S5 file Is first recorded on the disc, this offset^SPN must be zen?. 

[0196] Referring to Fig.4B, when the beginning portion of the AV strearri file is erased by editing, offset_SPN may 
assume a value other than 0. In the present embodiment, the relative source packet number (relative address) refer- 
encing the offset.SPN is frequently described in. the form of RSPNxxx, where xxx Is nidified such that RSPN^xxx is 
RAPN.EP.start. The relative source paclcet number is sized with the source packet number as a unit and is counted 

^ from the first source packet number of the AV stream file with the value of the offsat^SPN as the initial value. 

[01 97] The riumber of sou rce packets from the first source packet of the AV stream file to the source packet referenced 
by the relative source packet number (SPN^xxx) is calculated by the following equation: 

33 SPIsr.joo(=RSPNjooc-off8et_SPN. 
Fig.46 shows an instance In which offsejLSPN is 4. 

[0196] TS_recordlng_rate is a 24-bit unsigned Integer, which affords an Input/output bit rate required for the AV 
stream to the DVR drive (write unit 22) or from the DVR drive (readout, unit 28). The record_tlme_and__date Is a 56-blt 
40 f iold for storing the date and time of recording of the AV stream corresponding to the Ci^ and is an oncodod represen- 
tation of year/month/day/hour/minute in 4-bit binary coded decimal (BCD) for 14 numiarlcal figures. For example. 
2001/2^:01 !02:03 Is encoded to "0x20011223010203". 

[0199] The duration is a 24-bil field Indteatlng the total playt>ack time of the Clip by hour/mlnute/second based on 
arrival time clocks. This field Is six numerical figures encoded in 4-blt binary coded decimal (BCD). For example, 01 : 
43 45:30 Is encoded to "0x014530V 

[0200] A flag time^oontrolledjiag indicates the recording mode of an AV stream file. If tills tlme_controlied.flag 1^ 
1 , it Indicates that the recording mode Is such a mode In which the file size' Is proportionate to the time elapsed since 
recording, such that the condition shown by the following equation: 

so 

T8_average_rale*1 92/1 66*(t - startjme)- a slze.cilp(t) 
<= TS„average_rate* 1 92/1 8a*(t - startjilme) + a 

55 where TS.average.rate Is an average bit rate of the transport stream of the AV stream file expressed by bytes/second. 
[0201] In the above equatbn, t denotes the time in seconds, while startjime is the time point when the first source 
. packet of the AV stream file was recorded. The 8ize.clip(t) Is 10* 192. bytes and a Is a constarit dependent on- 
TS^average^rate. 
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[0202] If time^controlledjlag |8 set to 0, ft Indicates that the recording mode Is not controlling so that the time Idpse 
of recording is proportionate to the file size of. the AV stream; For example, the input transport stream is reicorded (n a 
transparent fashion. 

[0203] if time_controlled.^frag Is set to 1 , the 24-bit field of TS_averag'e_rate indicates the value of TS_average_rate 
s used in the ebove equation. If tlme^controlledjlag is set to O, this field has no meaning and must be set to 0. For 
example, the variable bit rate tr&nspori stream is encoded by me following sequence: First, the transport rale Is set to 
the value of TS.recordingLrate, The video stream Is encoded with a variable bjt rate. The transport packet Is iriterrnlt- 
tently encoded by not employing null paclcets. 

[0204] The 32-blt field of RSPN_anrivalJlme_dlscontlnulty is a relative address of a site where arrival timebase 
10 discoritlnultiea are produced on the BridgfrClip AV stream file. The RSPN_arrivaI_time„dl3contlnulty is sized with the . 
source packet nunnber as a unit and Is counted with the value of offset^SPN defined In the Cllplnfo() as from the.first 
SQunce packet of the Brklge-Clip AV strearn file. An absolute addrese in the BrMge-Cllp AV stream file Is calculated 
based on the aforementioned equation:. 
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pi205] The 1 44-blt field of reserverjor^system^use is reserved for a system. If is_format Jdentffler>alld flag is 1 , 
it indicates that the field of fbirriatjdentifier is effective. If isjomnatjdenllfier.valid flag is 1, it indicates that the 

20 format Jdentifier field is valid, if is.originaLrietworkJD.valki flag Is 1, it ihcficates that the field of 
ls_transport.stream_ID-v$lid Is valid, if the flag IsJransport^streamJD-yalkl is 1 , It Indicates • that the 
transport^stream.lD field Is valid, if fs.servece JD.valid flag is 1 . It Indicates that the sen^ece JD field Is valid. 
[0206] If ts.country code.valld flag Is 1, it indicates that the field country.code is valid The 32-blt field of 
formaUctentifier Indicates the value of fomiat^identlfler owned by a registratlon.descriptor (defined in IS0/1EC1 3818-1 ) 

25 In the transport stream. The 1 6-blt field of origlnaLnetwortelD Indicates the value of the ori^naLnetwqrk_ID defined 
in the transport stream. 

[0207] The 46-blt field In serveceJD denotes the value of serveceJD. defined In the transport strearri. The 24-bit 
field of country^code shows a countiy code defined by 1S03166. Each character code is encoded by IS08859-1. For. 
example, Japan Is represented as "JPN^! andis encoded to •*px4A 0x50 0x4P. The stre^ 
30 codes of ISO-646 showing the name of a format organization affording stream definitions of transport streams. An 
invalid byte if) this field has a value of 'OxFP. 

[0208] Fomiatjdehtmer, orlginaLnetwortelD, UansportLStreani^lD, servece^lb, country_code and 
streamIformat_rTame iridicate servk^ providers of transport streams. This allows to recognize encoding limitations on 
. audio or video s^anris and stream definitions of private data streams, other than audio video streams or SI (servk^e 

^ information). These infofmatk>n can be used to check If the decoder is able to decode the stream. If such decodlrig Is 
possible, the infomnation may be used to initialize the decodersystem before starting the decoding. 
. [0200] STC_lnfo Is now explained. The time domain In the MP EG'2 transport strearn not containing STC discontin- 
uous pplnts(dlscontlnuous points of the system time base) Is tended the STC_sequence. In the CHp, STC.sequence 
Is specified by the value of STC_sequenceJd. Flgs.50A and SOB illustrate a continuous STC domain. The sarne STC 

^ values never appear Ih the same STC.sequence, although the maxbrium tine length of Clip is limited, as explained . 
subsequently. Therefore, the same PTS values also never appear In the sanrte STC_sequence. If the AV streahn contains 
N STC di^contiriupus points, where N > 0, the Clip system time base Is split Into (N+l) STC_sequences. 
[0210] ' STC_lnfb stores the address of the site where STC discontinuities (system timebase discontinuities) are pro- 
duced. As explained with reference to Flg.51 , the. RSPN_STC^start Indteates the address and begins at a time point 

45 of arrival of the source packet referenced by the (k4-1)st RSPN.stc.stait and ends at a time point of arrival of the 
last source packet. 

[0211] Fig.52showsthesyritaxof the STC_lnfo. Turning to the syntax of STC Jnfo shown in Flg.52, verslon^number 
is four character letters Indteating the version rturnber of STC^lnfoQ. The versloh.number must be encoded to "0046" 
In accordance with ISO 646. 

50 [0212] Length is a 32-bit unsigned integer Indteating the number 6f bytes of STC Jnfo() from directly after this length 
flekJ to the end of STCjnfd. If CPLtypeof CPI() indicates TU.nriap type, 0 may be set In this length field. If CPLtype 
of CPjO Iridlcates.EPjnap type, the num_of_STC_spquehce mut be of a value not les^ 

[0213] Ah.8-blt uns^ned Integer of num_of.STC_sequence Indicates the number of sequences in the Clip. This 
• value Indicates the number of the for-loops next fbllowing the field. The Stc_sequence_id con-esponding to the preset 
«5 / STC^sequence Is defined by the order in whteh appeals the RSPN.STC^stiart corresponding to the STC_;Sequence., 
In the for-loop containing the RSPN_STC_start. The STC^sequenceJd comniences at 0 

[0214] The 32-bi1 field of RSPN.STC.start lndk:ates an address at which the STC.sequence conimehces oh the 
. AV streanr) file. RSPN_STC.8tart denotes an address where system time base discontinuities are produced in the AV 
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•stream file. The RSPN_STC.8tartmay also be a relative address of the source packet having the first PGR of the new 
system time base In the AV stream. The RSPN^STC^start Is of a size based on the source packet number and Is 
counted from the first source packet of the AV stream file with the ofTset^SPN value defined In CllplntoO as an Initial 
value. In this AV stream fUe^ the absolute address Is calculated by the above-mentioned equation, that Is 

5 

SPN^xxx = RSPN_xxx - offset^SPN. 

[02151 Programlnfo In the syntax of zzzz.clip shown In Flg,46 is now explained with reference to Rg.63. The time 
10 domain having the foitovying features )n the Clip Is temned program^sequence. These feature are that the value of 
PCR.PID Is not changed, the number of audio elementary streams is also not changed, the PID values in the respective 
video streams are not changed, the encoding Information which is defined by VIdeoCodinglhfo thereof Is not changed, 
the number of audio eiementaiy streams Is also not changed, the' PID values of the respective audio streanrts are not 
changed, and that the encoding information, which Is defined by AudloCodinglnfo thereof, is not changed, 
f? [0216] Program^sequence has only one system time base at the same time point. Program_sequence has a sole 
PMT at the same time point. Programihfo() stores the address of the site where the prograrrusequehce commences. 
RSPNj^rogram.sequence-start Indicates the address. 

[021 7] Fig.54 illustrates the syntax of Programlnfo. Turning to the Programlnfo shown In. Rg.54. ver8lon_number Is 
four character letters indicating the version number of Programinf o(). The verston^number must be encoded to "0045' 

^ In oecondance with ISO 646. 

[0218] Length is a 32-blt unsigned integer indicating the number of bytes of Programinfofl from directly at back of 
this length field to the end of program(lnfoO. If CPLtyps of CPI() indicates the TU^maptype, this length field may be 
set to 0. Jf the CPl^type of CPIQ indk:ates EP^map type, the number.of programs must be of a value not \im than 1 . 
[021 0] An 8-bit unsigned Integer of number.of j)rogram.8equence8 denotes the number of program^sequences In 

2S the Clip. This value Indteates the number of tor-loops next folbwing this field, if program^sequence ln the Clip Is not 
changed, 1 rnust be set In the number of program^sequences. A 32-bIt field of RSPNjprogram.sequence_Btart Is a 
relative address where the program sequence commenced on the AV stream. 

[0220] RSPN^rogram^sequence^start Is sized with the source packet number as a unit and is counted with the 
value of offset^SPN defined in the CllplnfoO as from the first source packet of the AV. stream tile. An absolute address 
30 in the AV stream file Is calculated by: 

SPN^x = RSPN^xxx - offeet^SPN. 

35 The values of RSPN j5rogram_sequence_start In the for-loop syntax must appear in the rising order. 

[0221] A 1 6-blt field of PCR.PID denotes the PID of the transport packet containing an effective PCR field effective 
for the program^sequence. An 8-blt field of number^of^audios indtoates the . number of for-loops containing 
audlo^stream^PlDahd AudloCodinglnfo(). A 16-blt field of video^atream^PID indicates the PID of the transport packet 
contalnlnga video stream effective for its program_eequence. VIdeoCoding|nfo(), next following thisfieW* must explain 

40 the contents of the video etream referenced by Its vIdeo.streamLPID, 

[0222] A 1 6-blt field of audlo.streamLPID Indbates the PID of a transport packet containing the audio stream effective 
. for Its program seque^nce. The Audk)Codlnglnfo(), next foltowing this flekl. mustexplain the contents of the video stream 
referenced by Its audlo_stream_PiD. 

[0223] The order in which the values of vldeo_stream_P ID in thef pr-ioop of the syntax must be eq ual to the sequence 
^ of PID encoding of the video stream in the PMT effective for the progran^sequence. Additionally, the order In whteh 
the values of audio_stream.PID appears In the for-loop of the syntax must be equal to the.sequence of PID encoding 
of the audio stream in the PMT effective for the program^sequence! 

[0:^4] Flg.55. shows the syntax of VldeoCbdlnglntb In the syntax of the Programlnfo shown in Flg,54. Turning to the 
syntax of the VldeoCodlng Info shown In Fig.55, an 8-blt field of video Jomnat indtoates the video f onnat corresponding 
50 to vldeo^stream^PID In ProgramlnfoQ, as shown In Flg.68. 

[0225] Referring to Fig.57, an 8'blt field of frame.rate indicates the video frame rate corresponding .to the 
video.stream.PID In ProgramlnfoQ. An 8-blt field of dlsplayi^aspect^ratlo Indicates a video display aspect ratio corre- 
sponding to vldeo_8tream_PID In ProgramlnfoQ. 

[9226] Flg.59 shows the syntax of AudloCodinglnfo In the syntax of Programlnfo shown In Ftg.54. Turning to the 
S5 syntax of the AudloCoding Info shown in Frg.69, an Srbit field of audlojonnat Indicates the audio encoding method 
corresponding to audlo_strearn_PID In Program lnfo(), as shown in Flg.80. 

[0227] An 8-bit field of audlo_component_type Indteates an audio component type comosponding to 
audio.stream_PID In Progremlnfo{) as shown In Fig.61 . whilst an 6-t>tt field of eampltngjrequency Indicates an audio 
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sampling frequency oorrosponding to audio_8tream_PlD In Programlnfo() as shown In Rg.62. 
[022$] The CPI (Characteristics Point Infcmnation) In the syntax of zzzzz.clip shown In Fig.45 Is explained. The CPI 
' Is used for correlating the time Infomnatlon In the AV stream with the address in Its file. The CPI is of two types, namely 
EP^map and TU_map, in Flg.63, If CPLtype in CPIQ is EP^map, Its CPI() contains EP^map. In Flg.64, If CPLtype In 

9 CPI() Is TU„map, Its CPIQ contains TU.map. One AV stream has one EP.map or one TU_map. If the AV stream Is 
an SESF transport stream, the conrespondlng Clip must own an EP^map. 

[0229] Flg.85 show the syntaix of . CPI. Turning to the syntax of CPI shown In Fig.65, the version^n umber is four 
character letters indicating the version number of this CPI(). The verslon^number mubt be encoded to "0045" in ac- 
cordance with ISO 646. length Is a 32-bit unsigned Integer Indicating the number of bytes as from directly after this 

10 length field to the trailing end of the CPIQ. The CPLtype is a 1 -bit flag end Indicates the CPI type of Clip, as shown In 
• Fig.6e.. ' ' ; 

[0230] . The EP_map In the CPI syntax shown In Flg.65 Is explained. There are h«o types of the EP_map, that Is 
EP.map for a video stream and an EP.map for an audio stream. The EP_map_type In the EP_map differentiates 
between these EP jnap types, if the Clip contains one or nrK>re video streams, the EP^map for the video stream must 
15 . be used. If the Clip does npt contain a video stream but contains one or more audio streams, the EP_map for the audio 
stream must be used. 

[0231] The EP_map for a video stream is explained with reference to Fig.67..The EP.map for the video stream has 
data stream^PID, PTS.EPjstatt and RSPN.EP.start. The 8treanri_PID ehows the PID of the transport packet trans- 
mitting a video stream. The PTS_EP_8tart Indicates the PTS of an access unit beginning from the sequence header. 
20 of the video stream. The RSPN_RP_6tart indicates the address of a source packet Including the first byte of the access 
unit referenced by ttie PTS_EP_start In the AV stream. 

[0232] A sub table, termed EPjfnapJor_one_stream_PID() Is created from one video stream transmitted by the 
transport packet having the same PID to another. If plural video streams exist In the Clip, the EP.map may contain 
plural EP_mapJor_one_strBam^PID(). 
25 [0233] The EP_map for audio stream has data stream_PiD, PTS_EP_stan and RSPN_EP_start. The* stream^PID 
shows a PID of a transport packet transniitting an aiidio stream. The PTS_EP_start shows the PTS of an accessing 
urtit in the audio stream. The RSPN_EP*start Indicates an address of a source packet containing a first byte of the 
access unit referenced by PTS^EP.start of the AV stream. 

[0234] THe s\A> table termed EP_niapJor_one_^tream_PID() Is created from one audio stream transmitted by the 
30 transport packet having the same PID to another. If there exist plural audio streanis^n the Clip. EP.map may contain 
plural EP map-_for_one streani.PIDO. 

[0235] Turning to the relatton between EP_map and STC^Info, one EP_map_for_one_stream_PIDO Is created In 
, one table In'especttve of discontinuous points In the STC. Comparison of the value of the RSPN.EP^start to the value 

of RSPN^STC.start defined In.STCJnfoQ reveals the boundary of data of EP.map belonging to respe^e 
35 STC^sequences (see. Flg.68). The EP^map must have one EP_n1apJpr_one_stream_PID for a continuous stream 

range transmitted by the same PID.< In the case shown in Fig. 69, program#1 and progranr)#3 have the same video PID, 

however, the data range Is not continuous, so that EP_map_for_one_8tream_PiD must be provided for each program. 

[0236] ng.70 shows the EP„map syntax. By way of explanation of the EP_map syntax ishown In Fig.70, the EP_type 
^ is a 4-bit field and shows the EP^map entry point ^pe, as shown In Flg.71 . The EPjtype shows the semantics of the 
^ data field next following this field. If Clip includes one or more video stream, the EP.type must be set to 0 (Vkteo*). 

Attematively, if the CKp contains no video stream but Contains one or more audio stream, than EPjIype must be set 

tol('audb'). 

[0237] The le^bit field of numk)er_of_8tream_PIDs Indteates the number of tln>es of loops of the for>loop having 
number_of_stream_PIDs in the EP.mapO as a variable. The 16-bit field of stream_PiD(k) Indteates the PID of the 
45 transport packet transmitting the number k elementary stream (videb or audio stream) . referenced by 
EPjiiapJor.on6.stream.Pip (nuni.EP.entr1es(k)). If EP Jype is 0 (Video'), its elementary stream must be a video 
stream. If EP.type Is equal to 1 Caudto'), its elementary stream must be the audio stream. 

(0238] The 16-btt flekJ of num_EP_entries(kj Indteates the num.EP_entrle8(k) referenced by EP_map_entrles(k)). 
The EP_map Jor_one_8tream_Pip_ Start_addres6(k): This 32-blt field Indteates the relative addreto position at which 
so the EP.mapJor.one.streanrLPID(num.EP_entrie8(k)) begins In the EP_map(). This value Is indksated by the size as 
from the first byte of .the EP_map(). . 

[0239] Paddlng_word must be Inserted in ac(i6rdance with the EP^mapQ syntax. X and Y must be optional positive' 
Integers. The respective padding words may assume any optional values. 

[0240] Flg.72 shows the syntax of EP_mapJor_one.stream_PID. By way of explanation of the .syntax of the 
55 EPjnapJor.one_8tream.PID shown in Flg.72, the semantics of the 32-bll ffeld of PTS.EP.start differs with the. 
EP.type defined by EP.mapQ. If EP.type is equal to 0 (Video*), this field has upper 32 bits of the 33-bil precision PTS 
of the access unit beginning with a sequence header of the video stream. If the EP.type Is equal to 1 ('audk>'), this 
fieM has upper 32 bits of PTS of 33 bit pfedaion of the,acce88 unit of the audio stream. 
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. [0241 J The semantics of the 32-blt field of RSPN.EP.start differs with the EP_type deflrved In EP_map(). If EP^type 
Is equal to 0 (Video*), this field Indicates the relative address of the source packet Including the first byte of the sequence 
header of the access unit referenced by the PTS.EP.start In the AV stream. Alternatively, If EPJype Is equal to 1 
('audio'), this field indicates the relative address of the source packet containing the first byte In the audio stream of 
5 the access unit referenced by the PTS_EP_start In the AV stream. 

[0242] RSPN.EP^start Is of a size which is based on the source packet number as a unit, and is counted from the 
first source packet of the AV stream file, with the value of the off8et_SPN, defined In Cllplnfo(), as an Initial value. The 
atMolute address In the AV stream file Is calculated by 

SPN^xxx=:RSPN.xxx-offseLSPN. 

[0243] it Is noted that the value of the RSPN^EP.start In the syntax must appear In the rising order. 
[0244] The TU^map Is now explained with reference to Flg.73. TU^map forms a time axis based on the source 
« packet amval time clock {timepiece of the arrive time base). Th\f time axis Is tended TU.map_tlme.axls. The point of 
origin of TLI_map_tim8„axis Is indteated by offset.time In the TU^mapO. TU_map_tlme_axls Is divided In a preset unit 
as from offset^tlme^ this unit being temned time.unlt. 

[0245] In each time.unit in the AV stream, addresses on the AV stream file of the source packet iii the first complete 
fomi are stored In TU^map. These addresses are temied RSPN Jlme..untt^start. The time at which begins the k(k 2 
50 0)th tlme„unll on the TU.map JIme.axIs Is tenned TU_startJlme(k). This value Is calculated based on the foltowing 
equation: 

TU_start Jlme(k) = offsetjlme + knime_unlt_sl2e. 
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[0246] It Is noted that TU_8tartJlme(k) has a precision of 45 kHz. 

[0247] Fig.74 shows tfie syntax of TU_map. By way of explanation of the TU_map syntax shown in Fig.74, the 32-blt 
field of offsetjlme gives an offset time relative to TU_mapjime_axls, This value indicates the offset time relath/e to 
the first time.unit in the Clip. The offseUime Is of a size based on 45 kHz clock derived from the 27 MHz precision 
30 arrival time ck>cks as unit. If the AV stream is to be recorded as new Clip, offsetjlme must be set to 0. 

[0248] The 32-blt field of time^unlt^slze affords the size of the time.unit, and is based on 45 kHz clocks, derh^ed 
from the 27 MHz precision arrivai time clocks, as unit. Preferably, time.unit.size Is not longer than one second 
(time.unMlze s 45000). The 32 bit flekl of number.of Jlme^unlLentrles Indicates the number of entries stored in 
TU_map(). 

S5 [0249] The 32-bit field of RSNjlme_unlt_8tan indicates the relative address of a site in the AV stream at whk;h 
begins each time^unit. HSNjime.unit.start is of a size based on the source packet number as unit and is counted 
with the value of offset.SPN defined In CliplnfoQ as from the first source packet of the AV stream file as an initial value. 
The absolute address in the AV stream file Is cakxjlated by 

^ SPN_xxx«RSPN_xxx-offset_SPN. 

[0250] It is noted that the value of RSNjlme_unlt_start In the for-loop of the syntax must appear In the rising order. 
If there Is no source packet In the number (k+1 ) time.unit, the number (k+1 ) RSN Jlme^unit^start must be equal to 
^ the number k RSPNjime_unlt_start. 

[0261] By way of expianation of the CUpMark in the syntax of zzzzz.ctlp shown In Flg;45. the CllpMark Is the. mark 
infonnatlon pertinent to clip and is stored in the CllpMark. This mark Is not set by a user, but is set by a recorder 
(recording and/or reproducing apparatus 1 ). 

[0262] Flg.75 shows the CllpMark syntax. By way of explanation of the CllpMark syntax shown in Flg.75, the 
so verelon.number is four character letters Indicating the verelon number of this CllpMark. The version.number must be 
encoded in accordance with ISO 646 to '0045'. 

[0263] Length is a 32-blt unsigned integer Indksating the number of bytes of the ClipMark() as from directly after the 
length field to the trailing end of ClipMarkQ. The number_of.Clip_marks is a 16-bit unsigned integer indicating the 
number of marks stored In QipMark and may be equal to 0. Marfc^type is an 8-bit field Indcating the vnaik type and Is 
55 encoded In accordance with the table shown In Flg.79. 

[0254] Mark^time.stamp Is a 32-btt flekl and stores the time stamp indteating a pointer having a specified mark. The 
semantbs of mBrk_ttme.stamp differs with CPl^type In the PlayList(). as shown in Fig. 77. 

[0266] If CPLtype in CPI() Indk^ates the EP.map type, this 6-blt field Indtoates the STC.sequenceJd of the contin- 
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U0U8 StC domain Where there Is plac»d markj 

has no meaning but Is set to 0. The B-bIt fJeld of Character^set Indicates the Indicating meThod of character fettere 
encoded In the mark^name field. The encoding method coh-esponds to the value show 

[0256] The 8-blt field of nam8_;tength Indicates the byte length of the mark name shown In the mark^name field. This . 
5 : mark^name field Indicates the mairk name. The byte number corresponding to the numl>er of the hamejength frem 
. left of this field Is the effective character number and denotes the mark narne;1nthBmark_namefiel^^ 
' following these effective character letters may be arbitrary; 
[0257] The field of ref^thumbnaiUndex indicates the Infomnation of the thunribnall picture appended to the mark. If 
the refjhumbnalljndex field Is of a value different from OxFFFF, a thumbnail picture Is added to Its mark, with the . . 
^0 thumbnail pk:ture being stored in the mark.thumb file. This picture Is referenced.using the value of ref.thumbnalijndex 
In the mark.thuhrtb.flleJf the ref Jhumbhailjndexfleld is of avalue equal t 
toitsmarlt. 

[0258] MakerPHvateData has already been explained with reference to Fig.22 and hence is not explained here spe- 

ciflcalty. ' . . ' ■ • ' 

« . [0259] Next, thunf>bnallJnfomlation is explained. A thumbnail pteture is stored In a menu.thmb file or In a mai1<.thmb 
. file. These files are of the same syntax structure and own a sole Thurhbnall(). The menu.thmb file stores a picture 
represianting respective PlatyLlsts. The totality of menu thumbnails are. stored . 
[OiSO] The mafk.thmb file stores a mark thumbnaU picture, that Is a pteture repr^^ 

of markthurnbnalls corresponding to the totality of PlayLlsts and Clips are stored In the sole mark.thmb file. Since the 
20 thumbnails are frequently added or deleted, the operation of addition and partial deletton must be executable readily 
and speedily; Forthis reason, Thmbnali() has a block structure. Picture data Is divided Into plural portions each of whteh 
Is stored In one tn.block. One picture data is stored in consecutive tn.biocks. in the string of th_bkx:ks, there may 
exist a tn.bkx:k not In use. The byte length of a sole thunribnail picture d vart^^^ 

[0261} Fig.78 shows the syntax of mjsnu.thmb and mark.thmb and Fig.79 ttie syntax of Thumbnail in the syntax of 
^ menu.thmb and mark.thmb shown in Flg.7a. By way of explanation of the syntax of Thumbnail, shown In Flg.79, 
yerslon.number Is four character letters denoting the version number of this ThunfibnailQ. Verslonjiumber must be 
encoded to "0045" In accordance with 180 646. . ' / 

[0262] Length is a 32-bit unsigned irtteger Indicating the number of bytes of MakerPrivateDataO as from directly at 
back of. the length field up to the trailing end of ThumbnailQ. Tu^bloct-StarLaddress is a 32-bll unsigned Integer 
30 indteating the leading end byte address of the firat tn_block, In tenro of the relative number of bytes as from the leading 

end byte of ThunhbnallO as a unit. The number of relative bytes Is counted from 0. Nurnber_of_thumbnall8 Is a 1 B-btt / . 

unsigned integer whteh gives the number of entries of a thumbnail pteture contained In ThunrtjnaiiO. 
[0263] Tu_biock_8lze is a 1 6-bit unsigned Integer which gives the size of one tn^block, in terms of 1 024 bytes as a ■ 
unjt. If/for example, tn_bIock^slze = 1 , It indicates that the size of one tn.block is 1024 bytes. Number_of_tn_bi6cks 
S3 Js^116-blt unsigned Integer Indfcalingthanumberof entfies of tn^biocic In this Thunribna» 

unsigned Integer Indicating the index number of the thumbnail picture represented by the thumbnail infomnation for 
one for-toop beginning from the thumbnaiijndex field. The value OxFFFF must not be used as Thumbnailjndex. This ' \- 
Thumbnalijndex is referenced by ref jthumbnaiijndex in UlApplnfoVolumeO. Ul ApplnfoPiayLlstO» PiayListMark() and 
ClipMark(). 

^ [0264] Thumbnailjplcturejomiat is an 8-bit unsigned integer representing the pteture format of a thumbnail picture 
. and assurhes a value shown In Rg.eOJn the table. DCFand PNG are allowed only in menu.thumb^ 
must assume the value of "0x00" (MPEG-2 Video 1 -picture). 

[0265] Plcture_data_sl2e Is a 32-blt unsigned integer Indicating the byte length of a thumbneiil picture in temns of 

bytes as a unit. StartJn_blocK_number is a 16-bit unsigned integer indicating the tn^biock n 
45 where data of the thumbnail plcturebeglns. The leading endof the thumbnail pteture data mustcolriclde with the leading 

end of the tp^block. The tn J)teck number begins from 0 and is relevant to the value of a variable k in the for-loop of 
. .th;iblock. . * . . . 

[0266] Xjplcturejength is a 164>lt unsigned imeger Indicating the number of pixels In the h^^ 

frame of a thumbnail picture. Ylpteturejength is a 1 erbit unsigned Integer Indicating thenumber of pixels In the vertical 
so direction of a f rame pf a thunribnall pteture. Tn_block Is an area In which to store a thumt>nail picture. AH tn.block In. 

the ThunribnaiiO are of tiie same size (fixed length) ?md are of a slize defined by tn.bloc^^^ - 

[0267] Rgs.81 A and 81 B schematically shpw how thumbnail pteture data are stored In tn.blpck, if. as shown in Figs. 

81 A and 81 B, the thun^nali picturd begins at the leading end of tn„block, and Is of a size exceeding 1 tn^block, it Is 
• stored Using the next foitowlngtn^biock. By so doing, data with a variable length can be managed as fl^^^ 
55 . so that the editing of deletion can be coped with by simplerprocessing. 

[0268] An AV stream file Is now explained. The AV stream file Is stored In the "M2TS" directory (Fig.1.4). There are . 

two types of the AV stream file, namely a Clip A stream file and a Bridge-Clip AV stream file. Both AV streams must : 

be of the structure of DVR IUPEG-2 transport stream file as hereinafter defined. 



23 



EP1 198 133 A1 



[0269] First, the DVR MPEG2 transport stream is explained. The structure of the DVR MPEG-2 transport stream Is 
shown In Flg.82. The AV streani file has the structure of a OVR MPEG 2 transport stream. The DVR MPEG 2 transport 
'stream Is made up of an Integer number of Aligned units. The size of the aligned unit Is 6144 bytes (2048*3 bytes). 
The Aligned unit begins from the first byte of the source packet. The source packet Is 192 bytes long. One source 

9 packet Is comprised of TP_extra_header and a transport packet. TP.extra.header Is 4 bytes long, with the transport 
packet being 188 bytes long^ 

[0270] One Aligned unit is made up of 32 source packets. The last Aligned unit in the DVR MPEG 2 transport stream 
Is also made up of 32 source packets. Therefore, the DVR MPEG 2 transport stream ends at a boundary of the Aligned 
unit. If the number of the transport packets of the Input transport stream recorded on a disc is not a multiple of 32, a 

10 source packet having a null packet (transport packet of PID = 0x1 FFFF) must be used as the last Aligned unit. The file 
system must not use excese Information In. the DVR MPEG 2 transport stream. 

[0271] Flg.83 shows a recorder model of the DVR MPEG 2 transport stream. The recorder shown in Flg.83 is a 
conceptual model for prescribing the recording process. The DVR MPEG 2 transport stream obeys this model. 
[0272] The Input timing of the MPEG 2 transport stream is now explained. The Input MPEG 2 transport stream is a 

^9 full transport stream or a partial transport stream. The Input MPEG 2 transport stream must obey the iSO/l EC1 361 6-1 
or ISO/IEC 13818-9. The number I byte of the MPEG 2 transport stream is Input simultaneously at time t(l) to T-STD 
(tmnsport stream system target decoder provided for in .SO/I EC 1381 8-1) and to the source packetizer. Rpk is an In- 
stantaneous maximum value of the Input rate of the transport packet. I . . 
[0273] A 27 MHz Pl-L 52 generates a frequency of 27 MHz clock. The 27 MHz clock frequency is locked at a value 

^ of the program clock reference (PGR) of the MPEG 2 transport stream. An anrivai time clock counter 53 courtts the 
pulses of the 27 MHz frequency. ArrlvaLtime_clock(i) is a count value of the arrival time clock counter.at time t(i). 
[0274] A source packetizer 54 appends TP_extra^header to the totality of the transport packets to create a source 
packet. An'lvaljlme.stamp Indteates the time when the first byte of the transport packet reaches both theT-STD and 
the source packetizer. Arrlvatjlme_stamp(k) is a sampled value of the Arrivaijime.ciock(k) as represented by the 

^ following equation: 

an'lvaLtime_8tamp(k) » anival_tlme_elock(k)% 230 

30 where k denotes the first byte of the transport packet. 

. [0278] If the time separatton between two neighboring transport packets is 23072 7000000 sec (about 40 sec) or 
longer, the difference of the arrivaLtlme.stannp of the two transport packets should be set to 230/2 7000000 sec. The 
recorder Is provided for such case. 

[0276] A smoothing buffer 55 smoothes the bitrate of the Input transport stream. The smoothing buffer must not 
35 overflow. Rmax Is the output bitrate of the source packet from the smoothing buffer when the smoothing buffer is not 
null. If the smoothing buffer is null, the output bitrate of the smoothing buffer is 0. 

[0277] Next, the parameters of the recorder model of the DVR MPEG 2 transport stream are explained. The value 
of Rmax is given by TS.recordlng.rate as defined In CHplnfoO associated with the AV stream file. This value may be 
calculated from the following equation: 
40 . 

Rmax = TS_reoordlngLrale*1 92/1 88 

whers the value of TS_recordlng_rate Is of a size In bytes/second. 
^ [0278] If the Input transport stream is an SESF transport stream, Rpk must be equal to TS.recording^rate as defined 
in CiiplnfoO associated with the AV stream file. If the Input transport stream is not an SESF transport stream, reference 
may be made to values defined e.g., In a descriptor of the MPEG 2 transport streiam. such as 
maximum^bltrate^descrlptor or partlaL8tream_.de8criptor for this value. 

[0270] If the input transport stream is an SESF transport strearii, the smoothing buffer size Is 0. if the jnput transport 
so stream is not an SESF transport stream, reference may be made to values defined in the descriptor i)f the MPEG 2 
transport stream, such as. for exarhple, the values defined In the smoothlng^buffer.descriptor, short.smoothlng 
_buffer_descriptor or In the partial_transport_stream_descriptor; 

[0280] For the recorder and the player (reproducing apparatus), a sufficient size buffer needs to be provided. The 
default buffer size Is 1536 bytes. 
09 [0281] Next, a player model of the DVR MPEG 2 transport stream is explained. Fig.84 shows a player model of the 
DVR MPEG 2 transport strearp. This Is a conceptual model for prescribing the reproduction process. The DVR MPEG 
2 transport stream obeys this moc^l. 

[0282] A 27 MHz X-tai 61 generates the frequency of 27 MHz. An error range of the 27MHx frequency must be ±30 
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ppm (2 7000000± 81 0 Hz). The arrival time ctock counter 62 Is a binary counter for counting the pulses of the frequency 

of 27 MHz. Anival J^jclock(i) is a count value of the arrival time clock counter at time t(l) . 

[0283] In the smoothing buffer 64» Rmax Is the input bitriate of the source padcet to the smoothing buffer when the 
' smoothing buffer is not full, if the smoothing buffer is full» the input bitrate to the smoothing buffer is 0. 
5 [0284] BywayofexplainlngtheoutpmtlmingoftheMPEGZtransportstream.ifthearrivaiJime^s^ 
• source packet Is equal to 30 bits on the L8B side of arrivaLtlme_clock(i), the transport packet of the source packet is 

removed from the smoothing buffer. Rpk Is an Instantaneous maximum value of the tran^rt packet rate. The overflow 

of the smoothing buffer Is not allowed. 

[0285] The parameters of the player model of the DVR MPEG 2 transport stream are the same as those of the 

10 recorder modei of the DVR MPEG 2 transport stream described above. 

[0286] Fig.BS shovys the syntax of the source packet. Transportj3acket() Is an MPEG 2 transport stream provMed 
in ISO/IEC 13818-1. The syntax of TP Extra-header in'the syntax of the source packet shown in Flg.85 is shown In 
Rg.86. By way of explaining the syntax of the TP.Extra-header, shown in Flg.BS, copyjpenmlsston^indicator Is an 
Integer representing the copying limitation of the payload of the transport packet The copying limitation may be copy 

'5 free, no more copy, copy once or copying prohibited. Flg.87 shows the relation between the value of 
copy^snnission.indicator and the mode It designates. 

[0287] Copy_pennls8lonjndlcator is appended to the totality of transport packets. If the input transport stream Is 
recorded using the iEEE1394 digital Interface, the value of copyjsenfhissionjndicator may be associated with the 
value of EMI (encryption mode indicator). If the Input transport stream is recorded without employing the IEEE1dd4 > 
20 digital interface, the value of copy_penni8sion_indk:ator may be associated wRh.the value of the CCI embedded in the 
transport packet If an analog signal input is self-encoded, the value of copy J|)enni88k)n Jndk»tor may be associated 
with the value of CGMS-A of the analog signal. 

[0288] AnrivaLtlme^stamp Is an integer having a value as specified by arrivaLtime.stamp In the foltowing equation: 
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anivaLtimejBtamp(k) = anivai.time.ciock(k)%230. 

[0289] By way of defining the CilpAV stream, the CilpAV stream must have a stnjcture of the DVR MPEG 2 transport 
stream defined as described above. An1vaLtime.ciock(i) must Ihcrease continuously In the Clip AV stream. If there 
30 exists a discontinuous point of the systm time base (STC baise) In the Clip AV stream, arrival.tlme.clock(l) In the Clip 
AV stream must increase continuously. 

[0290] The maximum value ot the different of the amvai Jime^clock(i) between the beginning and the end of the Clip 
AV stream must be 26 hours. This llmltatton guarantees that, if there is no discontinuous point in the system time base 
(STC base) In the MPEG 2 transport strsami the PTS (presentation time stamp) of the same value never appears In 
S9 the Clip AV stream. The MPEG 2 system standard provMes that the PTS has a wraparound period of 233/90000 sec 
(about 26.5 hours). 

[0291] By way of defining the Bridge^tlp AV stream, the Bridge-Clip AV stream must have a stnicture of the DVR 
MPEG 2 transport stream defined as described above. The Brldge-Ci^ AV stream must Include a discontinuous point • 
of one anrfval time base. The transport stream ahead and at back of the discontinuous point of the arrival time base 

40 must obey the encoding limitations and the DVR-STD as later explained. 

[p292] The present embodiment supports the video-audio seamless connection between Playltenns being edited. 
Seamless connection between Playltems guarantees "continuous data supply" to the player/decoder and "seamless 
decoding processing". The "continuous data supply" is the capability of guaranteeing data supply to the decoder at a 
bitrate necessary to prevent buffer underflow, in order to enable data to be read out from the disc as data real-time 

45 properties are assured, data Is to foe stored in terms of a continuous block of a sufficiently large size as a unit. 

[0293] The "seamless decoding processing" means the capability of a player in displaying audio vkieo data recorded 
on the disc without producing pause or gap In the playback output of the decoder 

[0294] The AV stream, referenced by the seamless connected Playltems, is explained. Whether or not the seamless 
display of a previous Playltem and the cun^ent Playitem is guaranteed may be verified from the connectton_condllion 
50 fieM defined in the current Playltem. There are two methods for seamless connectton of Playltems, that is a method 
employing Bridge-Clip and a method not eniploylng Bridge<;iip. 

[D295] Flg.88 shows the relatton, between the prevkius Ple^ltem and the cun'ent Playltem in case of employing 
Bridge-Cl^p. In Rg.88, the stream data, read out by the player, is shown shaded. In Rg.88. T81 is rpade up of shaded 
stream data of the C\\p^ (Clip AV stream) and shaded stream data previous to RSPN.an1val_time_discontinuity. 
S5 [0296] The shaded stream data of Clip1 of TS1 is stream data from an address of a stream reiquired for decoding 
the presentation unit corresponding to IN.Item of the previous Playltem (shown as IN-timel in Fi9.88) up to the source 
packet referenced ' by RiSPN_exltJrom_previous_Cllp. The shaded stream data, prior to 
RSPN_arrival_tlme.di8conttnulty of Bridge-Clip contained in TS1 Is s^tream data as from the first source packet of 
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Biidge-Cllp up to the source packet directly previous to the source packet referenced by 
RSPN.arrlvalJfrine.dlscontlnuity. 

P297] tn Flg.88, TS2 Is made up of shaded stream data of Clip 2 (Clip AV stream) and shaded stream data subse* 
quent to RSPN.arrlvaljIme^dlscontlnufty of BrkJge-Clip, The shaded stream data as from the 

5 RSPN^arrlvaLllme^dlscontlnulty of Bridge-Clip contained In TS2 stream data from the source packet referenced by 
RSPN^arrhralJIme^dlscontlnully to the last source packet of Bridge-Clip. The shaded stream data of Cllp2 of TS2 Is 
stream data from the source packet referenced by RSPN^enler Jo.cun'enLCIIp lo the address of the stream required 
for decoding the presentation unit corresponding to OUT^tlme of current Playltem (shown by OUT_tlme2 In Rg.88). 
C02da] Fig. 89 shows the relation between the previous Playltem and the cun^nt Playltem In case of not employing 

10 Bridge-Clip. In this case» the stream data read out by the player Is shown shaded. In Flg.e9J81 Is made up of shaded 
stream data of the Cllp1 (Clip AV stream). The shaded stream data of Cllp1 of TS1 Is data beginning at an address of 
a stream necessary In decoding a presentation unit corresponding to IN.tlme of the previous Playltem, shown at 
INjImel In Flg.89 as far as the (aet source packet of CUpl . 
[0290] In Rg.89» TS2 Is shaded stream data of Clip2 (Clip AV stream). 

15 [0300] The shaded stream data of Clip2 of TS2 Is stream data beginning at a first source packet of Cllp2 as far as 
an address of the stream necessary for decoding the presentation unit corresponding to OUT.tlme of currant PlayKem 
(shown at OUTjime2 in Flg.89). 

[0301] In Rgs.88 and 89. TS1 and T2 are continuous streams of the source packet. Next, the stream provisions of 
TS1 and TS2 and the connection conditions therebetween are scrutinized. First, encoding limitations for seamless 

20 connection are scrutinized. By way of limitations on the encoding structure of a transport stream, the number of pro- 
grams contained In TS1 and TS2 must be 1 . The number of video streams contained In TS1 and TS2 must be 1 . The 
number of audio streams contained In TS and TS2 must be 2 or less. The numbers of the audio streams contained in 
TS1 and TS2 must be equal to each other. It is also posislble for elementary streams or private streams other than 
those depk^ted above to be contained In TS1 and/or TS2. 

^ [0302] The limitations on the video bitstream are now explained. Flg.80 shows atypteal seamless connection Indi- 
cated by a picture display sequence. In order for a video stream to be demonstrated seamlessly In the vk:lnity of a 
junclton point, unneeded pictures displayed at back of OUTJImel (OUTJIme of Cllp1 ) and ahead of IN Jlme2 (IN Jime 
of Cllp2) must be removed by a process of re-encoding the partial stream of the Clip In the vtelnlty of the junctton point. 
[0303] Flg.91 shows an embodiment of realizing seamless connection using BridgeSequence. The video stream of 

30 Bridge-Ciip previous to RSPN^arrivalJime^dlscontlnulty Is comprised of an encoded video stream up to a picture 
corresponding to OUTjimel of CHp1 of Flg.90. This video stream Is connected to the video stream of prevk>us Cllpl 
and Is re-encoded to fomi an elementary stream confomiing to the MPEQ2 standard. 

[0304] The video stream of Bridge-Cllp subsequent to RSPN_an1valjlme_di8cohtlnulty is made up of an encoded 
video stream subsequent to a pteture corresponding to iN_tlme2 of Cllp2 of Flg.90. The decoding of this video stream 

35 can be started correctly for connecting the vWeo stream lo the next foltowing Cllp2 video stream. Re-encoding is made 
such that a sole continuous elementary stream oonfomilng to MPEG 2 standard will be formed. For creating Bridge-Clip, 
several pictures in general need to be re-encoded, whilst other pictures can be copied from the original Clip. 
[0305] Rg.92 shows an embodiment of realizing seamless connection without employing BridgeSequence In the 
embodiment ehown In Fig.90. The Cllpl video stream Is comprised of an encoded video stream as far as the picture 

40 coHBspondlng to OUTjimol of Flg.90 and Is re-encoded so as to give an elenr>entary etneam oonfomilng to the MPEG2 
standard. In similar manner, the vkieo stream of Clip2 Is made up of encoded bitstreams subsequent to the picture 
associated with tN_tlme2 of Clip2 of Flg.90. These encoding biUtreanDs are already re-encoded to give a sole contin- 
uous elementary stream confonnlng to the MPEQ2 standard. 

[0306] By way of explaining encoding limitations of the video stream, the frame rates of the vkieo streams of TS1 
45 and TS2 must be equal to each other. The video stream of TS1 must be terminated at sequence.end.code. The video 
stream of TS2 must comnience at Sequence header, GOP Header and with an l-pteture. The video stream of TS2 
must commence at a closed GOP. 

[03071 The video presentation units defined in a bitstream (frame or field) must be contlnudus with a Junction point . 
In-between. No gap of the fields or frames are allowed to exist at junction points. In case of encoding employing 3-2 
90 pulldown, It may be necessary to rewrite "topjleld Jrst" and "repealJIrsLfieW" flags. Alternatively, loceil re-encodIng 
may be made to prevent field gaps from being produced. 

[0308] By way of explaining encoding limitations on the audio bitstream, the audio sampling frequency of TS1 and 
that of TS2 must be equal to each other The audio encoding method of TSI and that of TS2 (for example. MPEG1 
layer 2, AC-3. SESF LPCM and AAC) must be equal to each other. 
S5 [0309] By way of explaining encoding llmltatbns on MPEG-2 transport stream, the last audio frame of the audio 
stream of TSI must contain audio samples having a display timing equal to the display end time of the last display 
picture of TS1 . The first audio f ranne of the audio stream of TS2 must contain an audto sample having a display timing 
equal to the display start timing of the first display picture of TS2. 
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(031 0] At a Junction point; no gap may be allowed to exist In a sequence of the audio presentation units. As shown 
:j - in Fig.93, there may t>e an overlap defined by the length of the audio presentation unit less than two audio frame 

domains. The first pacl<et transmitting an elementary stream of TS2 must be a video packet. The transport stream at 

the Junction point must obey the DVR-sto which will be explained subsequently. 
8 [0311] By way of explaining limitattons on the Clip and Bridge-Clip, no discontinuities in the arrival time base are . 

allowed to exist In TS1 or In TS2. 

[0312] The following limitations are applied only to the case of employing the Brtdge-Cllp. The Bridge-Clip AV stream 
has a sole discontinuous point In the arrival time base only at a Junction point of the last source packet of TS 1 and the 
first source packet of tS2. The SPN.arrivaiJime.dlscontinuity defined in CiiplnfoQ represents an address of the dts- 
10 continuous point, which must represent the address referencing the first source packet of TS2. 

[0313] The source packet referenced by .RSPN_exlt.from_prevlous_Clip defined in BridgeSequoncelnfoQ may be 
any source packet in Cl^1 . It is unnecessary for this source packet to be a boundary of the Aligned unit. The source 

' packet.relerenced by RSPN.enter.to.currant.Ctlp defined In BrldgeSequencelnfoQ may foe any source packet in 

Cilp2. It Is unnecessary for this source packet to be a boundary of the Aligned unit, 
w [0314] By way of explaining limitations on Playltem, the OUTjlme of the previous Play Item (OUT Jhne 1 shown In 

i Fig.89) must represent the display end time of the last video presentation unit of TS1 . The IN.tlme of the current 

PlayTlme (iN_tlme2 shown In Flg.88 and 89) must represent the display start time of the first presentation unit of TS2. 
[0315] By way of explaining the Iftnltatlons on the data allocation in case of employing Bridge-Clip by referring to Fig. 

I 94, the seamless connection must be made to guarantee continuous data supply by the file system. This must be 

I 20 realized by arranging the Bridge-Clip AV stream, connecting to Cilpi (Clip AV stream file) and Cllp2 (Clip AV stream 
file), such as to satisfy data allocation prescriptions. 

[0316] RSPN_exlLfromj3revlous_Clip must be selected so that the stream portion of Cllpl (Clip AV stream file) 
I . previous to RSPN.exIt Jnxh jsrevtous.Clip will be arranged in a continuous area not less than half fragment. The data 
i length of the Bridge-Clip AV stream must be selected so that the data will be arranged In the continuous area not less 

25 than half fragment. RSPN.enter Jo.currenLCiip must be selected sothat the stream portion of Clip2 (Clip AV stream 

file) subsequent to RSPN_enter_to_cunrent_Cllp will be arranged In a continuous area not less than half fragment. 

[0317] By way of explaining data allocation limttations in case of seamless connection not emptying Bridge-Clip, 

by refening to Rg.95, the seamless connection must be made so as to guarantee continuous data supply by the file 

system. This must be realized by arranging the last portion of the Cllpl (Clip AV stream flle).and the first portion of the 
^ Cllp2 (Clip AV stream file) so that the provisions on data allocation will be met. 
'\ [0318] The last stream portion of Cllpl (Clip AV stream file) must be arranged In a continuous area not less than one 

i* half fragment. The first stream portion of Cllp2 (Clip AV stream file) must be arranged in a continuous area not less 

i than one half fragnrwnt. 

[0319] . In a case where digital AV signals each having a predetennlned bit riate are fragmented and recorded on a 
\ 39 disc, to assure that the recorded digital AV signals can be read out from the recprdlng medium 1 00 In the predetermined 

bit rate, the size of one continuous recording area must satisfy the following condition: 

S*8 / (S*8mud + Ts) >= Rmax 

I 40. 

where 

S: minimum size of one continuous recording area [ByteJ 

Ts: access tbne of full stroke from one recording area to next recording area [second] 
^ Rud: bit rate for reading out from recording medium [bit/second] 

Rmax: bit rate of AV stream [bit/second]. 

[0320] That isi the data must be arranged so that S byte or more data In the AV stream may be recorded continuously 

on the disc. 

50 [0321] The data must be arranged so that the size of the half fragment may be S byte or more. 

) [0322] Next. DVR-STD Is explained. This DVR-STD is a conceptual model lor modeling the decoding processing in 

the generation and verification of the DVR MPEG 2 transport stream. The DVR-STD is also a conceptual model for 
modeling the decoding processing in the generation and verifksatlon of the AV stream referenced by two Playttems 

f seamlessly connected to each other as described above. 

. S5 [0323] Fig.96 shows a DVR-STD model. The model shown In Rg.96 includes, as a constituent element, a DVR 
) MPEG 2 transport stream player model. The notation of n, Tbn, Mbn, Ebn, Tbsys, Bsys, Rxn, Rbxn, Rxsys, Dn, Dsys. 

On and P9(k) is the same as that defined In T-STD of ISO/IEC 1381 8-1 . wherein n is an index number of an elementary 

stream and TBn Is a transport buffer of the elementary stream n. . 
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[0324] MBn Is a multiplexing buffer of the elementary stream n and exists only for the video stream. EBn Is an 
elementary stream buffer of the elementary stream n and is present only for the video stream. TBsys is a main buffer 
In a system target decoder for the system Information for a program being decoded. Rxn Is a transmission rate with 
which data is removed from TBn. Rbxn is a transmission rate with which the PES pacl(et payload is removed from MBn 
9 and Is present only for a video stream. ' 

[0325] Rxsys is a transmission rate with which data Is removed from TBsys. Dn is a decoder of the elementary stream 
n. Dsys Is a decoder pertinent to the system information of a program being decoded. On Is a re-ordering buffer of the 
video stream n. Pn(k) is a number k presentation unit of the elementary stream. 

[0326] The decoding process for DVR>STD Is explained. During the time a sole DVR MPEQ 2 transport stream is 
^0 being reproduced, the timing of inputting the transport paci<et to TBI , TBn or TBsys la determined by arrival Jlme_stamp 
of the source packet. Tho prescriptions for tho buffering operation of TBI , MB1 , EB1 , TBn Bn, TBsys and Bsys are the 
same as those of the T-STD provided for in ISO/IEC 13818-1 , while the prescriptions for the deciding and display 
operations are also the same as the T-STD provided for in ISO/IEC 13618-1. 

[0327] The decoding process during the time the seamlessly connected PlayUste are beir^g reproduced is now ex- 
is plained. Here» the reproduction of two AV streams referenced by the seamlessly connected Playltems is explained. In 
the following explanation, the reproduction of TS1 and TS2. shown for example in FIg.ea, is explained. TS1 and TS2 
are a previous stream and a current stream, respectively. 

[0328] Flg.97 shows a timing chart for Inputting, decoding and display of transport pacicets when transfening from 
a given AV stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2). During transfer from a preset AV 

^ stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2). the time axis of the arrival time base of TS2 
is not the same as the time axis of the an^lvai time base of TS1 (Indicated by ATC1 In Flg.g/). 
[0329] Moreover, the time axis of the system time base of TS2 (indicated by ATC1 In Fig.97) is not the same as the 
time axis of the system time base of TS1 (indicated by STC1 In Flg.97). The video display is required to be continuous 
seamlessly, however, there may be overlap in the display tine of the presentation units. 

2s [0330] The input timing to DVR-STD is explained. During the time until time T1 , that Is until the Inputting of the iaist 
video pacicet to the TBI of DVR-STD, the input timing to the buffers of TBI , TBn or TBsys of DVR-STD Is determined 
by an1val_time_8tamp of the arrival time base of TS1 . 

[0331] The remaining pacicets of TS1 must be input to buffers of TBn or to TBsys of DVR-STD at a bitrate of 
TS_recordlng_rate (TS1). The TS^recordlng^rate (TS1) is the value of TS.recording^rate defined in Cliplnfo() corre- 
30 spending to Cllp1 . The time the last byte of TS1 is input to the buffer is the time T2. So. during the time between time 
T1 and time T2» arrlval^tlme^stamp of the source pactcet is discounted. 

[0332] if N1 Is the number of bytes of the transport packet of TS1 next following the last video packet of TS1 , the 
time DT1 from time T1 until time T2 Is the time necessary for N1 bytes to be input completely at a bitrate of 
TS_recordlng.rate (TS1), and is calculated In accordance with the following equation: 

35 

DTI = T2 - T1 = N1/TS_recordlng_fBte. 

[0333] During the time from time T1 until time T2 fTSI ). both tho values of RXn and RXsys are changed to the value 
40 of TS-recordlng_rate (TS1). Except this rule, tho buffering operation is the same as that of T-STD. 

[0334] At time T2, the arrival time clock counter is reset to the value of an-lval Jime.stamp of the first source packet 
of TS2. The input timing to the t)uffer of TBI . TBn or TBsys of DVR-STD Is determined by arrtval.Ume.stamp of the 
source packet of TB2. Both RXn and RXsys are changed to values defined In T-STD. 

[0335] By way of explaining additional audio buffering and system data buffering, the audio decoder and the system 
45 decoder need to have an additional buffering amount (data amount equivalent to one second) In addition to the buffer 
amount defined In T-STD In order to allow input data of a domain from time T1 to time T2. 
[0336] By way of explaining the video presentation timing, the display on the video presentation unit must be con- 
tinuous, that is devoid of gaps, through Junction point. It Is noted that STC1 is the time axis of the system time base of 
TS1 (lndk:ated as STC1 in Rg.g), while STC2 Is the time axis Of the system time base of TS2 (shown at STC2 in Fig. 
so g7; con-ectly, STC2 begins bt time the first PGR of TS2 has been Input to the T-STD), 

(0337] The offset between STC1 and STC2 is delemilned as follows: the PTS1 end is the PTS on STC1 corresponding 
to the last video presentation unit of TS2. PTS2start is PTS on STC2 corresponding to the first vWeo presentation unit 
of TS2 and Tpp is the display time period of the last video presentation unit of TS1 , the offset STC.delta between two 
system time bases Is calculated In accordance with the following equation: 

55 

STC.delta » PTSIend + Tpp - PTS28tart. 
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[0338] ^ way of explanation of the audio presentation timing, there may be overiap in the display timing of the audio 
presentation unit, with the overlap being less than 0 to 2 audio frames (see "audio overlap" shown in Flg.97). The 
indlcatlonfasto which of audio samples is to be selected and re-synchronization of the display of the audio presentation 
unit to the corrected time base at back of the Junction point are set on the player 
9 [0339] By way of explaining the system time ctock of DVR-STD, the last audio presentation unit of TS1 Is displayed 
at time T5. The system time dock may be overlapped between time JZ and time 16, During this time domain, the 
DVR-8TD switches the system time clocks between the value of the oM time base (STC1) and the value of the new 
time base (STC2). The value of STC2 may be calculated In accordance with. the following equation: 

. STC2 = STC1-STC.delta. 

P340] Thd buffering continuity is explained. STCHvideo^end is the value of STC on the system time base STC2 
when the first byte of the first video packet reaches TBI of DVR-STD; STC22vldeo_start is the value of STC on the 
system time base STC2 when the first byte of the first video packet reaches TBI of DVR-STD. STC21 vldeo_end is 
the value of STC11 vldeo^isnd calculated as the value on STC2 of the system tlnr>e bdse STC2. STC21vldeo_end Is 
calculatad. in accordance with the following equation: . * . 

3^ STG21video_end:sSTU11video_end-STC_delta. 

[0341] In order to obey DVR-STD, thefoliowlng two conditions must be met First, the arrival timing of the first video 
packet of tS2 at TB1 must satisfy the following Inequality: 

25 

STC22video_start > STC21 video_end.+ ATI . 

[0342] If It is necessary to re-encode and/or multiplex the partial stream of Gllpl and^or Ciip2; In such a manner that 
the above! inequality will be satisfied, this re-encoding or multiplexing Is perfomied as appropriate. 
30 [0343] Second, the inputting of the video packet from TS1 followed by the inputting of the video packet from TS2 on 
the time axis of the system lime base, mapped from STC1 and STC2 on the same time axis, must not overflow or 
underf tow the video buffer. 

[0344] If the above syntax, data structure and the rules are used as basis, the contents of data nscorded on the 
recording medium or the reproduction information can be managed properly to enable the user to confirm the contents 
95 Of data recorded on the recording medium at the time of naproductkm or to reproduce desired data extremely readily. 
[0345] In the above-described embodiment, the MPEQ 2 transport stream Is taken as an example of the multiplexed 
stream. This, however, Is merely exernplary, such that the MPEQ 2 program strearn DSS or the transport stream used 
In the DirecTV Service (trade mark) of USA may alsd be used as the multiplexed stream. 

[0340] Fig.ga shows a modificatton of BrldgeSequencelnfo(). The difference from the BrIdgeSequenoelnfoO of Fig. 

40 38 is that It contains only Brldg8_CllpJnformatlon_file_hame. 

[0347] Fig.99 Illustrates Brldge^Clip when two Playltems cuia seamlessly connected In case of using the syntax of 
BrIdgeSequenoelnfoO of Fig.ge. RSPN_exiLfrom_prevrou8_Cllp Is the source packet number of the source packet on 
, the Clip AV stream rsferehced by the previous Playltem. Next to this source packet Is connected the first source.packet 
of the Bridge_Cllp AV stream file. 

^ [0348] RSPN_enterJo_cun'ent_Clip Is the number of the source packet on the Clip AV stream referenced by the 
cuHBnt Playltem. Ahead of this source packet Is connected the last source packet of the Bridge-Clip AV stream file 
referenced by the currant Playltem. In the Bridge-Clip AV stream, shown in Fig.99. SPN J\TC„start indicates the source 
packet number of the source packet In the Bridge-Clip AV stream file at which commences the time axis of new arrival 
. time base. 

so [0349] The Bridge-Clip AV stream fie has a sole anivai time base discontinuous point. The second SPN_ATC_start 
In the drawings has the same meaning as that of the RSPN.arrlvartime^discontlnulty in Fig;37. 
[0350] If the syntax of BridgeSequencelnfo() of Fig*98 is used, RSPN_exlt^fromj>reyious.Cllp and 
RSPN^enterJccurrenLCIIp are stored In the Clip infomnatlon file con'espondlng to the Bridge-Clip AV stream file. 
SPN.ATC_8tart Is also stored in the Clip Infomrtatlon file. 

95 [0351] Fig.1 00 shows the syntax of the Clip Infonnation file when the BridgeSequencelnfo is of the syntax of Fig.98. 
Sequencelnfo_8tart_address Indicates the leading address of SequencetnfoQ, in tenms of thenumberof relative bytes 
from the leading byte of the Clip Information file as a unit. The number of relative bytes is counted from 0. 
. [0352] Flg.101 shows the syntax of Cliplnfo() of theClip Infonnatlonflleof Flg.100. Cltp.stream.typeindtoateswheth- 
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er the AV stream file of the Clip is the Clip AV stream file or the Bridge*Cllp AV stream file. If the Cllp.stream.type 
indicates the Bridge-Clip AV stream file, the next syntax field follows. 

10353] Prevlou8.CtlpJnfomiationJile.name Indicates the Clip information fite name connected ahead of the 
Bridge-Cllp AV stream file. RSPN^exltJromjjrevlous.Cllp Is the source packet number of the source pacl<et on the 
s Clip AV stream file Indicated by prevlou8_Cllp_lnf ormatlon Jlle.name. Next to this source packet Is connected the first 
source packet of the Bridge-Clip AV stream file. This source packet number is counted as from the first source packet 
of the Clip AV stream file, with 0 as an initial value. 

[0354] Cunent.Clip.inf ormation Jile_name indicates the Clfp infonnatton file name of the Clip connected at back of 
the Brkige-Clfp AV stream file. RSPN_enter Jo^current,C«p is the source packet number of the source packet on the 
10 Clip AV stream file Indteated by the current.Cllp.lntormatlon^flle^name. Ahead of this source packet is connected the 
last source packet of the Bridge-Clip AV stream file. This source packet number Is the is counted as from the first 
source packet of the Clip with the AV stream file with 0 as an Initial value. 

[0355] Fig.102 indicates the syntax of the SequencelnfoO of the Clip Infonratlon file of Flg.100, 
Num.of_ATC.sequence Indkrates the number of the ATC^sequence in the AV stream file. ATC_sequence Is a sounse 
18 packet sequence not containing discontinuous points of the arrival time base. In the case of Bridge-Clip, this value is 2. 
[03S6] SPN_ATC_staft[atc_id] indicates an address at whteh commences the anival time base indicated by atc_ld 
on the AV stream file. SPN_ATC_start[atcJd) is of a size based on the source packet number as unit and is counted 
as from the first source packet of the AV stream file with 0 as an Initial value. 

[0357] Figs.1 03A and 103B illustrate database change in case stream data of the Clip AV stream file referenced by 
^ Bridge-Sequence is partially erased. It Is assumed that, as Indicated by "Before Editing" in Flg.103A. Cllpl and ClipZ 
are interconnected by Brtdge-Clip, with RSPN.exltJromj)revlous_Cilp = X and.RSPN^enterjo.current^CIlp = Y 
[0358] It is assumed that a stream data portion of Z1 source packets of Clipl , shown shaded, and a stream data 
portton of Z1 source packets of Cilp2, likewise shown shad^, are to be erased. As a result, 
RSPN_exit.from_prBVious_Ciip becomes equal to X- Z1 and RSPN.enterJo.cun^nt.Clip becomes equal to Y-22. 
28 by way of value changing, as Indicated by "After Edittncf In Rg.103B. 

[0359] By changing the syntax of the database pertinent to BrIdgeSequence as shown in Figs.96 and 1 01 . the Infor- 
mation pertinent to the source packet number indtoating a data address in the AV streamed field commencing from 
RSPN In the database syntax) is depleted from the layer of the PlayUsl. such that the totality of the Infomiatton on the 
source packet number Is stated in the Clip layer. 
so [0360] In this case, If It Is necessary to change the value of the data address In the AV stream; as when data of the 
AV stream file has been partially erased, It is only suffksient If measly the Clip Infomnatlon file Is supervised as data, 
thus advantageously facilitating database management. 

[0361] Flg.1 04 is a flowchart illustrating the preparation of the RealPlayLlst. Raference.ls had to the block diagram 
of Ffg.l showing the recording and/or reproducing apparatus 1 . At step SI 0, a controller 23 records a Clip AV stream. 
88 At Step S11 , the controller 23 fonns PiayUst() made up of Playltems covering Uie totality of the possible playback range 
. of the above Clip, if there is STC discontinuous point in the Clip, and PlayLlstQ is made up of two or more Playltems, 
the conne(^on.condltlon between the Playltems Is also detennined. 

[0362] At step S12, the controller 23 fomns UIApplnfoPlayLiat(). At step S13. the controller 23 forms PlayLlstMark, 
At step 14, the controller 23 fomis Makers PrivateData. At step SI 5, the controller 23 records a Real PiayUst file, In 

40 this manner, one Real PiayUst file is created each time a Clip AV stream file is newly recorded. 

[0363] Flg.1 06 is a flowchart for illustrating the formulation of a Virtual PlayLlst having a bridge sequence. At step 
320, reproduction of one Real PiayUst recorded on the disc Is specified through a user Interface. From the reproduction 
range of the Real PlayLlst, the reproduction domain specified by IN and OUT points is specified through user interface. 
[0364] At step S21 , the controller 23 verifies whether or not the operation of specifying the reproduction range by 

45 the user has been finished In its entirety, if It is verified that the specifying operation has been finished, the controller 
23 proceeds to step S22 and, if otherwise, the controller 23 reverts to step S20 to repeat the subsequent processing: 
[0365] At step S22. the user detemnines the connectton condition between two continuously reproduced Playltems 
(conhectlon.condition), through user interface, or the controller 23 determines the connection condition. At step 823, 
the controller 23 fonns a brkige sequence for the seamlessly connected Playlten^. At step S54, tghe controller 23 

80 fomis and records the Virtual PlayLlst file. 

[0366] Flg.1 06 is a flowchart for illustrating the detailed processing at step S23. At step S31 . the controller 23 re- 
encodes and re-multiplexes an AV stream on the OUT point skie of the Playitem displayed on the tenriporally foiY^ard 
side. At step S32, the controller 23 re-encodes and re-multiplexes the AV stream on the IN point side of the Playitem 
represented next to the Playitem. 

88 [0367] At Step S33, the controller 23 determines the value of the RSPN^exIt Jromjsrevious^Cllp such as to satisfy 
the data allocation condition for continuous data supply. That Is, RSPN.exit Jrom^revious.ClIp must be selected so 
that the stream portion of the Clip AV stream file previous to RSPN_exlLtrom_prevlous_Cllp will be recorded In a 
continuous area not less than the aforementioned half fragment on the recording medium (see Flgs.01 and 04). 
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[0368] At step 834, the controller 23 determines the value of RSPN.enter.to.current.CI^:) such bs to satisfy the 
data allocation condition for continuous data supply. That Is, RSPN_enterjo_current_Clip must be selected so that 
the stream portion of the AV stream file subsequent to RSPN^enter.to.current.CIlp will be anayed In a continuous • 
area not less than the aforementioned one fragment on the recording medium (see Figs.91 and 94). 
s [0369] At step S35» the controller 23 forms the.Brfdge-CI|p AV stream file such as to satisfy the data allocation con- . 
ditlon for continuous data supply. That Is, if the volume of data prepared In the processing of steps 831 and 832 is less 
than the sizeof the aforementioned one half fragment, data Is copied from the original Clip to prepare Bridge-Clip (see 
Flg8.91 and 94). 

[0370] Although the processing operations of steps S33 to S35 is explained chronologically, these processing oper- 
10 atlons may alQO be carried out nbn-sequentlaity or simultaneously since these processing operations are relevant 
reciprocally. 

[0371] At step 836, the coritroller 23 forms a bridge sequence databaee. At step 837, the controller 23 records a 
BridgeClip AV stream file and Its Clip information fite. In this nruinner, one or more Playltem le selected by the user 
front the reproduction range of Real PlayList recorded on the disc. A bridge sequence for enabling seamless connection 
19. of two Playltems is fonmed and a set of one or more Playltems, grouped tOjgether, Is recorded as one Virtual P)ayUst. 
[0372] Flg.1 07 is a flowchart for illustrating the reproduction of PlayList. At step 841 , the contrDller 23 acquires Info, 
dvr, a Clip Infonmation tile, a PlayList file and the thumbnail infonmatton to prepare a GUI picture a list of PlayLists 
recorded on the disc to display the so formed picture on the GUI through user Interface. 

[0373] At step 842. the controller 23 presents the infonr^atlon llustratirig the PtayUst on the GUI picture based on 
^ UlApplnfpPiayListO of each PlayList. At step 843. the user instructs reproduction of one PlayList from the GUI picture 

through a user Interface. At step 844, the controller 23 acquires, from the PTS of IN^tlme and STC-sequecne-ld of fho 

cumsnl Playltehfi, a source pacicet having an entry point temporally previous and closest to IN„time. 

[0374] At step 845, the controller 23 reads out data of the AV strearri frorn the source pacicet number haying the 

above entry point to send the so read out data to decoder, if, at step 846, there Is any Playltem temporally previous 
^ to the cunrent Playltem, the controller 23 perfomns the processing of Interconnecting the previous Playltem and the 

current Playltem in accordance with connection_conditioD. If the .Playltems are interconnected seamlessly, the AV 

stream is decoded based on the DVR-8TD decoding method. 

[0375] At step 847, the controller 23 oomrtiancte the AV decoder 27 to start the display as from the picture of the 
PT8 of lN_time. At step 848, the controller 23 conrimands the AV decoder 27 to continue decodlrig the AV stream. At 

30 step 849. the controller 23 verifies whether or not the picture curently displayed Is the picture of PT8 of OLrr.time. If 
It is verified that the picture currently displayed is nc^ the picture of PTS of OUT_tlnr)e, the controller 23 proceeds to 
step S50 to display the picture, after which the controller 23 reverts to step S4B to repeat the subsequent processing. 
[0378]. If it Is verified at step 849 that the picture cunently displayed is the picture of PTS of OUT.time, the controller- 
23 proceeds to step 851 where the controller 23 verifies whether or not the current Playltem is the last one in the 

3S PlayList. If it is verified that the curent Rayltem Is not the last one, the controller 23 reverts to step 844 to repeat the 
subsequent processing. If it is verified that the current Playltem is the last one. reproduction of the PlayList Is finished. 
[0377] In this manner, the one RayLlst file, specified to be reproduced by the user, is reproduced. 
[0378] Based on the above-described syntax, data strucfture and rule, as described above, the contents of data 
racordsd on the recording medium, the playback Information and so forth can be properly managed to enable the user 

40 to confinin the contents of data.recorded on the recording medium properly to reproduce the desired data extrennely 
readily. * . 

. [0379]. The at>ove*descr{bed sequence of operations may be executed not only by hardware but also by software, if 
the sequence of operations is to be executed software, it is Installedfrom a recording medium to a computer in the 
dedicated hardware of which is installed the program fomning the software or to e.g., e general-purpose personal 

^ computer capable of executing various functions based on a variety of programs installed therein. 

[0380] Fijg. 1 08 shows an IliustiBtive inner structure of a general-purpose computer. A CPU (central processing unit) 
201 of the personal computer executes a variety of processing operations-in accordance with a program stored in a 
ROM (read-only memory) 202. in a RAM (rendonvaccess memory) 203, there are suitably stored data or programs 
necessary for tlie CPU 201 to execute various processing operations. To an input/output interface 205 Is conriected 

so an input unit 206 fonmed by a Iceyboard. a mouse and so forth to output signals input to the input unit 206 to the CPU . 
201 . To thq input/output Interface iZOS, there is also connected an output unit 207 rnade up of a display, a loudspeaker 
andsoforth, 

[0381] To the input/output interface 205, there are also connected a recording unit 208 made up e.g., of a hard disc 
and a conrvnunloation unit 209 adapted for exchanging data with outer equipment over a network, such as Intemet. A 
S8 drive 210 is used for reading out or writbig data on or from a recording medium, such as a magnette disc 221 , an optical . 
disc 222, a magneto-optical disc 223 or a semteonductor memory 224. 

[0382] The recording medium Is constituted not only by a package medium distributed for furnishing the program to 
the user, in addition to a computer, such as a magnetic disc 221 carrying the program thereon, ihclushre of a floppy 
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disc, an optical disc 222, Inclusive of a CD-ROM (Compact Disc-Read-Only meniory) or a DVD (Digital Versatile Disc), 
a magneto-optical disc 223, inclusive of a Mini-Disc, or a semiconductor memory 224, but also by a hard disc, inclusive 
of a ROM 202 carrying a program and a memory 208, furnished to the user as It la built-in in a computer, as shown In 
Flg.108. 

9 [0383] In the present specification, the steps of the program furnished by the medium Include hot only the chrono- 
logical processing in accordance with the sequence indicated, but also the processing performed not chronologicafly 
but in parallel or separately. 

[0384] Additionally, In the specification, the system means an entire apparatus comprised of plural component de- 
vices. 

10 

Industrial Applicability 

[0386] In the infomiatlon processing method and apparatus, and the program, according to the present Invention, If 
the it is commanded to perform reproduction continuously from the first AV stream to the second AV streaim, there is 

IS generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which Is reproduced when reproduction is switched f rohfi the first AV stream to the second AV stream, while 
there Is generated, as the Information pertinent to the third AV stream, the addrsaa Infonnatipn made up of the infor- 
mation on an address of a source pacltet of the first AV stream at a timing of switching of reproduction from the first 
AV stream to the third AV stream, and of the Infonnation on the address of a source packet of the second AV stream 

^ at a timing of switching of reproduction from the third AV stream to the second AV stream. So. reproduction may be 
achieved such as to maintain continuity In separately recorded AV streams. 

[0388] In the infomiatlon processing method and apparatus, and the program, according to the present invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address infomiatlon 
made up of the Infonnation on an address of a source packet of the first AV stream at a timing of switching of reproduction 

^ from the first AV stream to the third AV stream, and the Information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, is read out from 
the recording medium as the information pertinent to the third AV stream, and reproduction Is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based on the read-out infomiatlon pertinent to the third AV stream. So, reproduction may be achieved such as to 

30 maintain continuity in separately recorded AV streams. 



Claims 

39 1. An infonnation processing apparatus comprising: * 

generating means for generating. In case continuous reproduction from a first AV stream to asecond AV stream 
is commanded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of 
saJd second AV stream, said third AV stream being reproduced when reproduction is switched from said first 

. ^ AV stream to said second AV etream, and the address Infonnation. as the infomiatlon pertinent to said third 

AV stream, said address infonnation being made up of the fnfonnation on an address of a source packet of 
said first AV stream at a timing of switching of reproduction from said first AV stream to said third AV stream, 
and of the Informatbn on the address of a source packet of said second AV stream at a timing of ewltehing of 
reproduction from said third AV stream to said second AV stream; and 

45 recording means for recording said third AV stream and said address Infonnation, as generated by said gen- 

erating nr>eans. 

2. The Infonnation processing apparatus according to claim 1 wherein an arrival time stamp of the source packet of 
said first AV stream Included In said address Infonnation generated by sakJ generating means, and an anival time. 
so stamp of a source packet located at a leading end of said third AV stream, are continuous to each other, and 
wherein an arrival time stamp of the source packet of said second AV stream Included In said address Infonnation 
generated by said generating means and ah an'ival time stamp of a source packet located at a trailing end of said 
third AV stream are continuous to each other. 

so 3. The infonnation processing apparatus according to claim 2 wherein a sole discontinuous point exists in the anival 
time stamp of the source packet in saki third AV stream. 

4. The information processing apparatus according to claim 2 wherein said address is detennined so that a data 
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portion of the AV stream previous to a source packet specified by tlie infonnatlon on the address of the source 
packet of said.flrst AV stream contained in said address information generated by said generating means will ba 
located In a continuous area of not less than a preset size on a reicording medium. 

The Information processing apparatus according to claim 2 wherein said address is determined so that a data 
portion of the AV stream subsequent to a source packet specified by the Information on the address of the source 
packet or said second AV stream contained In said address Infonchation generated by said generating means will 
be located in a continuous area of not less than a preset size on a recording medium. 



I 10 6. The information processing apparatus according to claim 2 wherein said third AV stream Is generated so that said 
I third AV stream will be located In a continuous area of not less than a preset size on said recording medium. 

7. An Infbmnatlon generating rhethod comprising: 

" a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is conrv 

manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address Infonnatlon, as the Information pertinent to said third AV stream, bM address 
20 information being made up of the Information on an address of a source packet of said first AV stream at a 

timing of switching of reproduction from saM first AV stream to said third AV stream, and of the infomiation on 
. the address of a source packet of said second AV stream at a timing of switching of reproductk>n from said 
third AV stream to said second AV stream. 

^ 8. A recording medium having recorded thereon a computer*readable program, saki program comprising: 

a step of generating, in case continuous reproductton from a first AV stream to a second AV stream is com* 
manded, a third AV stream nr^de up of a preset portion of said first AV stream and a preset portk>n of said 
second AV stream, said third AV stream being reproduced when reproduction Is switphed from said first AV' 
30 . stream to saki second AV stream, and 

a step of generating the address infomnation, as the intonnation pertinent tq said third AV stream, said address 
infonmation being made up of the Information on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from saM first AV stream to saki third AV stream, and of the infonrvation on 
. the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
39, third AV stream to said second AV stream. 

9. A program for having a computer execute a program, said program comprising: 

a step of generating. In case continuous reproduction from a first AV stream to a second AV stream is com- 
4P mended, a third AV stream made up of a preset portk>n of said first AV stream and a preset portton of saW 

second AV stream, aaki third AV stream being reproduced when reproduction is switched from saki first AV 
stream to saM second AV stream, and 

a step of generating the address Infomiatipn, as the Infonination pertinent to said third AV stream, said address 
infomnatlon being made up of the infonmation on an address of a source packet of said first AV stream at a 
48 timing of switching of reproduction from said first AV stream to said third AV stream, and of the infonnation on 

the address of a sbunce packet of said second AV stream at a timing of switching of reproduction from saki 
third AV stream to saki second AV stroam. 

. 10: An information processing apparatus comprising: 

50 

. first readout means for reading out a first AV stream, a second AV stream or a third AV stream from a recording 
medium; 

second readout means for reading out, as the Infomnatlon pertinent to said third AV stream, the infomnatlon 
on an address of a source packet of said first AV stream at a timing of switching of reproduction from said first 
55 AV Stroam to said third AV stream, and of the inf omiation on the address of a source packet of said second 

. AV stream at a timing of switching of reproduction from said third AV stream to saki second AV stream; and 
reproducing means for perfomning reproduction as reproduction is switched fronri sakj first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream. 
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based on the Information pertinent to eaid third AV stream read out by said second readout nr^eans. 

11. An Infonnation processing method comprising: 

5 a first readout controlling step of reading out a tlrst AV stream, a second AV stream or a third AV stream from 

a recording medium; 

a second readout controlling step of reading out. as (he Infomnatlon pertinent to said third AV stream, the 
Infonnatton on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from eald first AV stream to said third AV stream, and of the Information on the address of a source packet of 
10 • said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing stop of performing reproduction as reproduction Is switched from eald first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to saki second AV stream, 
based on the Infonmatlon pertinent to said third AV stream read out by said second readout means. 

15 

12. A recording medium having recorded thereon a computer-readable program, said program comprising: 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording nnedium; 

^ a second readout controlling step of reading out. as the Infomiation pertinent to said third AV strsam. the 

Infonmatlon on an address of a source packet of said first AV stream at a timing of switching of reproductk>n 
from said first AV stream to said third AV stream, and of the infomiation on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

S5 a reproducing step of perfonnlng reproduction as reproduction Is switched from said first AV stream read out 

by saM first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the Infonmatlon pertinent to said third AV stream read out by safd second readout means. 

13. A program for having a computer execute a program, said program comprising: 

30 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream fmm 
a recording medium; 

a second readout controlHng step of reading out. as the Infonmatlon pertinent to said third AV stream, the 
information on an address of a source packet of said first AV stream at a timing of switching of reproduction 
35 from said first AV stream to said third AV stream, and of the information on the address of a source packet of 

said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfomiing reproduction as reproduction is switched from said first AV stream read out 
by saitd first readout means to said third AV stream and from said third AV stream to said second AV stream, 
40 based on the Information pertinent to said third AV stream read out by said second readout means. 

14. A recording medium having recorded thereon the address informatton comprising, in ease continuous reproduotton 
from a first AV stream to a second AV stream Is commanded, a third AV stream made up of a preset portton of 
said first AV stream and a preset portion of said second AV stream, saki third AV stream being reproduced when 

^ reproduction Is switched from said first AV stream to said second AV stream, and the address Information, as the 
infomiation pertinent to said third AV stream, said address Infonnatlon being made up of the Information on an 
address of a source packet of said first AV stream at a timing of switching of reproduction from said first AV stream 
to said third AV stream, and of the Information on the address of a source packet of said second AV stream at a 
timing of switching of reproduction from said third AV stream to said second AV stream. 



BNSDOCIO: «EP 1 18ei33A1J.> 



34 



EP1 198 133 A1 




35 



11881 saAu.^ 



EP1 198 133A1 




FIG.2 



1186133A1J.> 



36 



EP1198 133 A1 



iiUlS 



IN POINT/ /: 
/POINT' ■ 



OUT \\ \^OUT 
POM! 'f. \P01NT 
IN : IN \ ' 
: POINT IPOINTa \ 



cup Information 
byte 

Clip AV stream 



/- 

4. — <L- 




sroiNT, 



POINT ^ 



* 
f 



-Din" 

<P01NT 



- Clip 





1 - 

i 

« 


« 

T, 

1 
« 
» 


■ 

! ? 


« 




m 


Cfip 





FIG.3 



37 



BN8 : ID:<EP. 



EP 1 198 133 A1 



Real PlayUst 



Clip 



Real PlayUst 














Clip 



FiG.4A 



DIVISION POIOT 



Real PlayUst 



CUp 



isar 

PlayUat 



PlayUst 



Clip 



r 



FIG.4B 



Real 
HayUfitl 








Clipl 





COUPUNG 



Ph3^8t2 



Ciip2 



RealPlayUstl 






Clipl 




Clip2 1 



FIG.4C 



38 



EP1 198133A1 



RealPlaylist 



Clip 



K BOTH RealPlaylist 

nZ) ANDCHpARE 
DELETED 



DELETED 



RealRaylist 



Playltem. 



Clip 



— ^ 

1 — 

1. 
1 


Real Playlet 


t 
1 
1 
« 


Playltem 


1 

« 1 

t < 


! .. ■ ' 


• 
t 

1 

t 
• 


Clip 



DELETED 



FIG.5B 



HiHilil 



RealHayUst 



CUp 



I 



DELETED 



RealPlaylist 



Clip 



DELETED 

F1G.5C 



39 



EP1 198133A1 



FIG.6A 



IN our 

POINT 1 POIWl 



FIG.6B 



Seal PlayListl 



Clipl 



IN 


OUT 




P0INT2 


?om2 












Real PlayList2 









N 


CUp2 



IN 

POINT 1..'' 



V IN OUT 

\p0iNr2 ?om2 

Playltem v>. 



I 


^PlayUsU 






' ^ 




CUpl 





ReatPlayLi 


8t2 






1 1^ 




C]ip2 





.1198t3aAlJ_^ 



40 



'ipi 198133A1 



.-Virtual Playtist 

Playltem 
(MAIN PATH).. 

" ■ — ' 

: SubPlayltem : 
. (SUB-PATH)^ . i 



IN 
POINT 1 



oirr 

POINT! 





Real Playlistl 






• ■ ■ 1 . 
• ■ 1 ' 






CBpl 






(MAIN AV STREAM) 





: IN 
^P0INr2 



: OUT 



RealF|ayList2 



aip2 

(SUPPLEMENTARY 
AUDIO STREAM) 



FIG.7 



EP1 198 133 A1 



REPLAY SEQUENCE 



RealPlayUstl 



RealFlayU8t2 



Virtual PlajrUstl 



Virtual PlayListl 



RealPlayIi8t2 



RealPteyUstl"] 



FIG.8 



42 



EP1 19&133A1 



PlayUst i 



CUp 



Playlist 

RESUMING 
BOOKMARK POINT 



Playlist 



V 



TT 

CM 



CM 



RESUMING] 
POINT 



sggNE ^ 




4h 



FIG.9 



43 

.vBNS iPCtD:<EP_^_:i10ai33A1J_> . . v 



EP1 198 133 A1 



VOLUME 



PERSONAL 
COMPUTER 
(PC) 



DEGITAL 
STILL 
CAMERACDSC) 



MENU THUMBNAIL 



IN-VOLUME 
IMAGE 




PLAYUST 



FiG.10 



PLAYUST MARK 




PiayUst 



U_L_L 



i i i □ 



MENU THUMBNAIL MARKTHUMBNAIL 



FIG.11 



BN80C3CID: <EP U99133A1J.> 



44 



EP 1 198 133 A1 



CLIP 



Clip t 



CUPNiARK 



I \ \ 



CUD nU 1—2 



MARKTHUMBNAIL 

FIG.12 



CZ3 



VOLUME 
THUMBNAIL 



MENU THUMBNAIL FILE 



PlayDst- 



CUp. 



□ 



□ 



□ 
o 
a 




czrl 
a 











□ 


□ 








o 


a 




a 

« 




a 



THUMBNAIL 
PICTURE 



MARK 
THUMBNAIL 
PICTURE 



FIG.13 



45 



EP1 198 133 A1 



root — DVR 



info.dvr 



menu.thmb 



mark.thmb 



PLAYUST 



DATA 



OlOOLrpls 



O2002.rpls 



99999.n>ls 



CUPINF 






OlOOOxlpi 






Q2000.clpi 






OaOOOclpi 








M2TS 






01000.in2ts 






O2000.in2t8 






O3000.in2t8 



FIG.14 



6N50OCID: *eP 1 19ei33Al_L> 



46 



EP1 Ids 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


info.dvr{ 






'nibleOmiiyLists.Start_address . 


32 


uimsbf 


MakensPrivateDat^JStBirt.address 


32 


uimsbf 


resenred 


192 


bslbf 


DVRVpiameO 






fpra-0;i<Nl;t++)( 






paddingjirord . ■ 


16 


bslbf 


\ 






TableOfPIayListsQ 






for(!-0;i<N2;i++){ 






. padding^word 


16 


bslbf . 


1 






MakmPriyateDataO 






•}•• 







FIG.15 



EPi 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVUTION 


DVRVolumeOI 






yersion.number 


8*4 


bslbf 


tensth 


32 




ResumeVolumeO 






inAppfofoVolameO 






1 







FIG.16 



119ei33Alj^ 



48 



EP1198 133A1 





NUMBER 




SYNTAX 


OFBVTES 


ABBKE^ON 


ResumeVohuneO i 






reserved 


15 


bslbf 




1 


bslbf 


K8iiiile!^nayList_iiaine 


8*10 


bslbf 


1 







FIQ.17 



49 



BN8 10: <EP. 



.iifiei8aAij_> 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIAHON 


UIAppInfoVoIumeOf 






character jset 


8 


bslbf 


naine_Iength 




uimsbf 


Volume.name 


8*256 


bslbf 


reserved 


15 


bslbf 


VolunMLprotectJIag 


1 


bslbf 


PIN 


8*4 


bslbf 


reLthumbnallJiidex 


16 


uimsbf 


reservedjror^lbture.use 


256 


bslbf 


1 







FIG.18 



BNSDOCiD: <EP 11flei3aA1J_> 



50 



• ■ . ■ ■ • • • • .• . -^^ 

EP1 198133A1 



VALUE 


CHARACTER LETTER ENCODING 


0x00 


Reserved 


QxOl 


ISO/IEC 646 (ASCII) 


0x02 


ISO/IEC 10646-1 (Unicode) 


Qx03^)xff 


Reseived 



FIG49 



/ 



EP1 198133A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TinbleOfPIayListsOl 






version_nimiber 


8*4 


bslbf 




32 


uimsbf 


number.of^PlayLlsts 


16 


uimsbf 


for 6»0: 'Knumberjo/^PlayUsts-, 






PlayList_flle_naine 


8*10 


bslbf 


} 






I 







FIG.20 



BNSOOCID: <EP 110Bt3aAlJ.> 



52 



EP1 188 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TableOiPlaylJstsOi 






versloii_niiinber 


8*4 


bslbf 


loisth 


32 


uimsbf 


namber_oC^yLists 


16 


; utmd>f 


&r G-O; \<numb€rj>fJ*layLists', i++) { 






nayLlstjnie.jianie 


8*10 


bslbf 


UlAppbifoPlayListO 






) 






) 





FIG.21 



.53 



/ 



EP1 198 133 A1 



SYNTAX 


NUMBER 


ARRRRVIATIOM 
ADOIICiTIAI lun 


MakersPrivateDataO ( 






version^ttmber 


8*4 


DSlDt 


length 


32 


uimsbf 


if Oength!«0){ 






iniNl3lock8.^tfirt.addre8S 


32 


— : — r; — - 
uimsbf 


namber^of^maker.entrles 


16 


uimsbf 


mpd^blockjslze 


16 


uimsbf 


namber^ot.iiipdj>locks 


16 


uimsbf 


reserved 


16 


• It* 
bslbf 


for 0-0; \<numberjof^maker^€ntries\ i++) ( 






makerJID 


16 


uimsbf 


inflker^inodd.code 


Iff 




6tart.inpd.block_number 


16 


uimsbf 


reserved 


16 


bslbf 


mpdjength 


32 


uimsbf 


) 






stiifflnK^bytes 


8*2*L1 


bslbf 


forO-0; }<numberj>fjnpdJfU>cks\ j++) { 






inpd^lock 


nipd_block^ 
si2en024*8 




1 






I 






) 







FIG.22 



54 

BNSDOCID: <€P 11flei33A1J_> 



EP1198133A1 

• »•• . ' • • • •■ ■ 



- SYNTAX 


NUMBER 
OF BYTES 


ABBREVIAnON 


xxxxxn^s / yyyyy.vpls { 






FiayLlstMarkj5tai1_address 


32 


uimsbf 


M9kardVivateDatiL.$taii_|uldms 


32 


uimsbf 


reserved 


192 


bstbf 


PlayListO 






fora-0;i<Nl;i++){ 






paddiiig_word 


16 


bslbf 


I- 






PlayLtstMarkO 






for (i-0;i<N2;i++){ 






paddingL.word 


16 


bslbf 


1 






MakersPrlvaiteDataO 













FIG.23 



55 



EP 1 198 133 A1 



Real PlayList 



Real PlayList 



Real PlayList 



Real PlayList 



FIG.24A 



RealPtoirlitl ^ [Real Playlist 



Real PlayList 



CUp 



FIG.24B 



I Clip If CHp f I~ Clip I I CKp I 



1 1 ctp fl cnp fl Clip I 



Virtual PlayList 



Real Playlist 



Real Play 
Ufit 



1 'cm, 'If^ l 





Virtual FUyUstI 










Real PlayList 


Real PlayUst 


• t 

* 1 




» * m 
» « *f 

1/ /: 

» ' . * * 


* • 



Clip 



Qip 



Clip 



FIG.24C 



BN9D0CI0: <EP 1 ieei33A1J_> 



56 



i 

li 

EP 1 198 133 A1 

i ' ■ 

i 

\ ' ■ • ' ■ 

i 



SYNTAX 


NUMBER 
ur diijm 


/U>DI\l!i V J/i 1 lull 


PlaylistOI 






verslonjiumber 


O *k 


DSIDI 


length 




uimsbf 


nayUst.type 


8 


uimsbf 


CPlJypt 


1 


bslbf 


reserved 


7 


bSlDl 


UIApj^oPlayListO 






number.of.PlayIteiii5 // main path 


10 


uimsbf 


if i<Vertual PlayUst>) { 






number.of.SubPlayIteni8 //sub path 


16 


uin^bf 


}else( 






reseived 


16 


bslbf 


} 






for (JPlayltemJd-0; 






PlayltemO //msm path 






\ 






if i<Vtrtual PlayUst>) \ 






if (CPI_type-"0&& PlayList.type— 0){ 






for O-O. i<number_ofJSubPlayltems; i++) 






SubPlayltemO //subpatii 






1 






» 






1 







RG.25 




57 



BNsS IDc<EP. 



.118813aA1J.> 



EP1 198 133 A1 



PlayLi8t_type 


MEANING 


0 


PLAY LIST FOR AV RECORDING 

ALL CLIPS REFERENCED IN THIS PLAY UST MUST 
CONTAIN ONE OR MORE VIDEO STREAMS 


1 


PLAY UST FOR AUDIO RECORDING 
ALL CUPS REFERENCED IN THIS PLAYUST MUST 
CONTAIN ONE OR MORE AUDIO STREAMS AND MUST 
NOT CONTAIN VIDEO STREAMS 


2-255 


reserved 



FIG.26 



BNSOOCID: <EP 119ei33Al J.» 



56 



EP1 198133A1 



SYNTAX 


NUMBER 
OFBYTES 


ABBREVUmON 


UIAppInfoPlaylistaOi 






chnracter_;^et 


8 


bslbf 


namejength 


8 


uimsbf 


nayList.jiaiiie 


8*256 


bslbf 


reserved 


8 . 


bslbf 


reoord.tiiiie.andudate 


4*14 


bslbf 


reserved 


8. 


bslbf 


duration. 


4*6 


bslbf 


vaUdLiwriod 


4*8 


bslbf 


makerjd 


16 


uimsbf 


maker.code 


16 


uim^f 


reserved 


11 


bslbf 


piaybacKjcentroLflsE 


1 


bslbf 


wrlte_ji>rotect_|lag 


1 


bslbf 


is_played_|lac '• ' , 


1 


bslbf 


archive 


2 


bslbf 


r^thumbnalUnidex 


16 


uimsbf 


reservedJ'or.^tiire.Dse 


256 


bslbf 


\ 







FIG.27 



s ©:<EP iieeiaaAijL^ 



EP1 198 133 A1 



write jjrotect_flag 


MEANING 


Ob 


THE PlayUst CAN BE ERASED FREELY 


lb 


THE PlayUst CONTENTS SHOULD NOT BE ERASED 
NOR CHANGED EXCEPT write-protect-ilas 



FIG.28A 



i8_playedjlag 


MEANING 


Ob 


THE PlayLiat HAS NOT BEEN REPRODUCED SINCE 
ITS RECORDING 


lb 


THE PlayUst WAS ONCE REPRODUCED SINCE ITS 
RECORDING 


FIQ.28B 


archive 


MEANING . 


00b 


NO MEANING DEFINED 


01b 


ORIGINAL 


10b 


COPY 


lib 


reserved 



FIG.28C 



BNSDOCID: <EP IIWiaaAlJ^ 



60 




61 



' iO:<EP. 



jt8ai3aAij.> 



EP1 198 133 A1 




EP1 198 133 A1 



I 




» IDc<H» tlM^SMIJ^ 



63 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


PIayItemO( 






<MpJntcrma.tkmJBitjaame 


8*10 


bslbf 


reserved 


24 


bslbf 


STC_^uenceJd 


8 


uimsbf 


IN^time 


32 


uimsbf 


. OUT.lhne 


32 


uimsbf 


reserved 


14 


bslbf 


coniiection_conditioii 


2 


bslbf 


if(<VirtualPlayU8t>)( 






if (eonnectionjcondlti0n=s'JO^\ 






BrldgeSequencelnfoO 






1 






) 






) • 







FIG.32 



BNSDOCID: «EP 119ei33AlJ_» 



64 



EP1 198133A1 



CPLtype 

in the HaylistO 


SEMANTICS OF IN^time 


EP_inap type . 


IN.tiroe MUST INDICATE UPPER 32 BITS OF 33 BIT 
LENGTH CORRESPONDING TO FIRST PRESENTATION 
UNITINPlayltem 


TULinap type 


IN^tiirie MUST BE TIME ON TU_nuip_timc_axis. AND 
MUST BE ROUNDED TO tiinejunit PRECISION. IN time IS 
CALCULATED BYFOLLOWING EQUATION: 

IN_liine -TU^start.time 562^ 



FiG.33 



65 



VBNS > iO:<EP. 



J.199133A1J_>.. 



EP1 198 133 A1 



CPLtype 

in tne ruyustu 


SEMANTICS OF OUT_tirae 


EPjmaptype 


OUT_time MUST INDICATE UPPER 32 BITS OF THE 
VALUE OF Presentation^ehdjrS CALCULATED BY 
FOLLOWING EQUnON: 

Presentatlon^end JTS - PTS^out+AU.duration 

WHERE PTS_out IS SS-BIT LONG PTS CORRESPONDING 
TO LAST PRESENTATION UNIT IN Playftem; AU_daraUpn 
IS 90 kHz-DISPLAYTIME OF LAST PRESENTATION UNIT; 


TU_niaptype 


Oimtime MUST BE TIME ON TU_map.time_axl8 AND BE 
ROUNDED TO time.unit PRECISION. OUT.tirae IS 
CALCULATED BY FOLLOWING EQUATION: 

OUT.time -TU.8tait_time 



FIG.34 



BNSOOCIO: <EP 118ei33A1 J_> 



66 



•I . 

1 EP 1 198 133 A1 



.■5 

i' 

5 



connection 
.condition . 


MEANING 


00 


• CONNECTION OF PREVIOUS Playltem TO CURRENT 
Playltem IS NOT SURE AS TO SEAMLESS REPLAY. 

• IF CPLtype OF PlayUst IS TtJ_map type, THIS VALUE MUST 
BE SET IN connection.condition. 


01 


•THIS STATE IS ALLOWED ONLY WHEN CPUtype OF 

Haylist IS EP_map type; 
• PREVIOUS Rayltem AND CURRENT Playltem INDICATE 

DIVISION BECAUSE OF NON-CONTINUOUS POINT OF 

SYSTEM TIMEBASE (STC BASE). 


10 


• THIS STATE IS ALLOWED ONLY WHEN CPI.type OF 
PiayList IS EP^map type. 

• THIS STATE IS ALLOWED ONLY FOR Virtual PfeiyLisL 

• CONNECTION OF PREVIOUS Playltem TO CURRENT 
Playltem IS SURE AS TO SEAMLESS REPLAY. 

• PREVIOUS rlayltem lo vUNNbLllsD lU LUKKbMl 
Playltem USING BridgeSequence. DVR MPEG>2 TRANSPORT 
STREAM MUST OBEY DVR-STD AS LATER DESCRIBED. 


11 


• THIS STATE IS ALLOWED ONLY WHEN CPI_type OF 
Playlist IS EP_map type. 

• CONNECTION OF PREVIOUS Playltem TO CURRENT Play 
Item IS SURE AS TO SEAMLESS REPLAY. 

- PREVIOUS Playltem IS CONNECTED TO CURRENT 
Playltem WTIHOUT USING BridgeSequence, DVR MPEG-2 
TRANSPORT STREAM MUST OBEY DVR-STD AS LATER 
DESCRIBED. 



i FIG.35 

i - ■ . • . 

i • ■ 



\ 

5 

\ 
I 

j 



•8N pOCID: <EP__118B133A1J> " .. y.-^^ u 



EP1 198133A1 



NON. 

PREVIOUS : .hrJ:!:?fr;IH" ; current 



CBp 



Clip 



connection.condition-'OO' 

FIG.36A 



IN^time OUT_time IN_time OUT_timc 

PREVIOUS I CURRENT 
Phyltem ! y Playltem y 



Clip 



connectioiL.condition«»'01' 



STC NON-CONTINUOUS POINT 
(NON-CONTINUOUS POINT 
OF SYSTEM TIME BASE) 



FIG.36B 



IN_time^^^„^, OUT.time 
I PREVIOUS 
! - Hayltem 



CUp 



IN_dme OUT time 

: CURRENT " 
! Playltem 



Clip 



■75+- 



BridgeSequence 

cup 



SEAMLBSS 
CONNECnON 

connedjon_condltlon«'10' 

FIG.36C 



INJime„„^,„^, OUT_timep_^§Kgl^M IN.time 

i PREVIOUS r tONNBCnON -, CURRENT 

Playltem ^ { ."'•'■"" Playltem 

Clip' 



Clip 



pUT.time 



3 



connection_condition«'ir 

FIG.36D 



68 



BNSDOCID: <EP 118B133A1J_> 



EP1 198 133 A1 



IN^timel OUT^tiniel 
PREVIOUS 
Playltero 



ClUpl 



RSPN_exitjfroin 
_])renotts_COp 



IN.tinie2 0UT_time2 
i CURRENT i 



/ ISPN.enter_to_ 
currentLCIip 



Bridg&CUp 
(CUpfor 

BiidgeSegueiice) *' 



)RSPN_arrival_time 
.discontinuity 



-ADDRESS 



FIG.37 



69 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


BridgfeSequencelnfoO ( 






Bridee_CllpJiifomiatlo^_flle_naiiie 


8*10 


bslbf 


RSPN.exltJh>mj)revloiis.CIip 


32 


uimsbf 


RSPN_enter_*o_cuiTcnt_CIIp 


32 


uimsbf 


J 







FIG.38 



BNSOOCia *EP 1 l9ei33Al,L» 



70 



EP 1.198 133 A1 



Playlist; 



Maiii_P^th>- 



Plaiylteihjd 
=0 



I^yltemJd 



Hayltenuid 
-f : H 



PTS-xx 



Start timing of I 
^chronismg | 



sync_PlayIteinJd»l, 
syric_stafLPIS_ot_Pl^Itein=xx 



Subj>ath 



SubPathJN time 
(PTS) 



SubPath_OUT_time] 
(FTS) 



CUp 

(SUPPLEMENTARY AUDIO STREAM) 



FIG-39 



71 



fD:<EP« 



_^_j1198ldaA1J_> 



EP 1 1S8 133 A1 



SYNTAX 


NUMBER 
QF BYTES 


* 

ABBREVIAllON 


SubHayltemOi 






Clip_InfonnAtlon_|ile_name 


8*10 


bslbf 


SubPath_type 


8 


bslbf 


syttcJ^ayltemJd 


8 


uimsbf 


qnic_^tarUPTS.oiUPlayItcm 


32 


uimsbf 


SubPatK_IN_tfme 


32 


uimsbf 


SttbPftth.OUT_tIine 


32 


uimsbf 


1 







FIG.40 



BNSDOCID: <EP 1108133A1J_> 



72 



EP 1 198 133 A1 



SubPaa\_lype 


MEANING 


QxOO 


Auxttlaiy audio steam path 


QxOl-CBcff 


reserved 



FiG.41 



73 

»i6 _>B:<EP ^•inisaAiju> . •■ ■. ■■••H 



EP1 1M133A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


PlaylistMarkOf 






versfonjaumber 


8*4 


bslbf 


length 


32 


uimsbf 


number_of.PlayList_niarks 


16 


uimsbf 


for ii'^<numberjc>/^PIayUs$^niarks;i'*-^^ 






reserved 


8 


bslbf 


mark.typa 


8 


bslbf . 


mark^tiinejrtamp 


32 


uinwbf 


nayltemjd 


8 


uimsbf 


resenred 


24 


uimsbf 


character jset 


8 


bslbf 


namajen^b 


8 


uimsbf 


raark^name 


8'256 


bslbf 


reLthnmbnalLIndex 


16 


uimsbf 


} 






1 





FIG.42 



BNSOOCID: «6P 119ei33AtJ.> 



74 



EP1 198 133 A1 



Mark_type 


MEANING 


COMMENT 


QxOO . 


resuihe-nuulc 


RBFIAY RESUME POINT. THE NUMBER OP 
REPLAY RESURE POINTS DEFINED IN 
HayListMarkO MUST BE 0 OR L 


0x01 


book-mark 


REPLAY ENTRY POINT OF PlayUsL THIS 
MARK CAN BE SET BY USER AND USED AS 
MARK SPECIFYING START POINT OF 
FAVORiTE SCENE. 


0x02 


skip-mai^ 


SKIP MARK POINT. PLAYER SKIPS 
PROGRAM FROM TfflS POINT TO THE END 
OF PROGRAM. THE NUMBER OF SKIP 
MARK POINTS DEFINED IN PlayUstMarkQ 
MUST.BEOROL 


QxOMxSF 


reserved 






resoVed 


Reserved for ClipMaiicO 



FIG.43 



ID: <EP_^__11«813aAij-> 



75 



EP1 198 133 A1 



CPLtype 

in the PlayLIstO 


SEMANTICS OF mark^tinie.stamp 


EPjonaptype 


mark.tiine_stamp MUST INDICATE UPPER 32 BITS OF 33 
BIT LENGTH PIS CORRESPONDING TO PRESENTATION 
UNIT REFERENCED BY MARK. 


TU_m^type 


mark^time.stamp MUST BE TIME ON TU_map_time_axls 
AND MUST BE ROUNDED TO time.unit PRECISION. 
niark_time.8tamp IS CALCULATED BY FOLLOWING 
EQUATION: 

markjiroe^stamp *> TU^starLtime %^ 



FIG.44 



BNSOOaO: <EP 110ei33A1J_> 



76 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OroiTEb 


ADDREVIAilO^ 


zzzzz.clpi ( 






STCJitfo_Start_address 


32 


uunsof 


ProgramImo_Start_aadress 


32 


uimsbf 


CPIjStart^address 


32 


uimsbf 


CltpMark^tart.address 


32 


uimsbf 


MakersPrivateData_Start_address 


32 


uimsbf 


reserved 


96 


bslbf ' 


ClipInfoO 






for(i«0;i<Nly++)( 






padding^word , 


16 


bslbf . 


} 






STC^InfoO 






fore»0;i<N2;i++)l 






i;iadding;_w(Hrd 


16 


bslbf 


1 






ProgramlnfoO 






for 0=0;i<N3;H'+){ 






padding^word 


16 


bslbf 


) 






CPIO 






lOr U'"U,I<IN4,I++^ 1 . 






.paddins_w6rd 


16 


bslbf 


)■ 






CaipMarkO 






forO-0;kN5;i++){ 






paddingjirord 


16 


bslbf 


\ 






MakersPrivateDataO 






■} . 







FIG.45 



77 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OFBYTES 


ABBREVIATION 


ClipInfoOl 






version^nuipber 


8*4 


bslbf 


length 


32 


uimsbf 


Clipjitrcam.type 


8 


bslbf 


offset.SPN 


32 


uimsbf 


TS.recordlng^rate 


24 


uimsbf 


reserved 


8 


bslbf 


record^time^and^date 


4*14 


bslbf 


reserved 


8 


bslbf 


duration 


4*6 


bslbf 


reserved . 


7 


bslbf 


ttine.controlled.JIa8 


1 


bslbf 


TSjBveragejrate 


24 


uimsbf 


iftCllp^treamjype^^l) /f Bridge-Clip AV stream 






RSPN^rrivaLtime^dlscontimiUy 


32 


uimsbf 


else 






reserved 


32 


bslbf 


re8erved.for_Qrstem.u8e 


144 


bslbf 


reserved 


11 


bslbf 


is_format.identlfler_vaIid 


1 


bslbf 


fa.orlglnal_iietworkJD.vaUd 


1 


bslbf 


is.transportjtream_ID_valld 


1 


bslbf 


Is.servlce_n>.valfd 


1 


bslbf 


fs^coimtry.code.valld 


1 


bslbf 


format jdentifier 


32 


bslbf 


orIflnal.network_ID 


16 


uimsbf 


tran8port^tream.]D 


16 


uimsbf 


service.ID 


16 


uimsbf 


country^code 


24 


bslbf 


streamjrormat.name 


16*8 


bslbf 


re8ervedJbr.fortune.use 


256 


bslbf 


1 







FiG.46 



78 

BNSDOCIOkEP M98133A1J.> 



EP1 198 133 A1 



Ctip_8tream.type 


MEANING 


0 


ClipAVSTTREAM 


1 


Bridge<:iipAV STREAM 


2-255 


Reserved [ 



79 



_ii8ei3aAij.> 



v.. } 



EP1198 133 A1 



original 
Clip 

Av stream 



r 



nRST SOURCE PACKET 
OF cup AV STREAM 



m 



^ offi3eLSPN-0 



ADDRESS OF Clip AV STREAM 
(RELATIVE SOURCE 
PACKET NUMBEIO 



edited 
Clip 

Av stream 



ERASURE OF SOURCE 
PACKETS SHOWN SHADED 



CD 



offeet^SPN-4 



ADDRESS OF Clip AV STREAM 
(RELATIVE SOURCE 
PACKET NUMBEIQ 



FiQ.48 



<ep 1 leeiaaAi j_> 



80 



EP1 198 133 A1 



CUp 

Avstream 



, FIRST SOURCE PACKET 
( OF cup AV STREAM 



4J 



of&et_SPN RSPN_?cxx 



ADDRESS OF Clip AV STREAM 
(RELATIVESOURCE 
PACKET NUMBEIO 



SPNjcxx*^ 



FIG.49 



TIME DOMAIN NOT 
CONTAINING STC 
NON-CONttNUOUS 
POINT 




O lARRIVALTIMEOF 
LAST BYTE OF PGR IN 
TS PACKET 



MRIVALTIME CLOCK 



FIG.50A 



STC 



TIME DOMAIN NOT 
CONTAINING STG 
NON-CONnNUOtJS 
POINT. 



STC-0 



STC33 BIT COUNTER IS 
WRAPAROUNDED HERE 




ARRIVAL TIME CLOCK 



81 



IO;<EP_ 



_110e«33A1JJ: 



■f. /, 



EP11M133A1 




82 

BNSDC3CI0: <EP 11Gei33AlJ_> 



EP1 198133A1 



SYNTAX 


NUMBER 
OFBYTES 


AB^REVUlTION 


STC_InfoO{ 






verstonLnainber 




bslbf 


length . 


32 


uimsbf 


^ifOeiigthl-OX 






resenred 


8 


bslbf 


numjofJSTC^equences 


a 


uimsbf 


ior {STC^equenceJd^O: 

SrC_jeqitenceJd<num_d/JTCjsequences: 
STCjeguenceJd+-ir){ 






reaereyed . . 


32 


bslbf 


KSPNJSTCjrtart 


32 




■ ■) • .-• 






■ ) 






) ■ •• ' 








EP1 198 133 A1 




BN800C10: <EP 11W133A1J.> 



64 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVUmON 


ProgramlnfoOf 






vmfon^nuinber 


8*4 


bslbf 


length 


32 


lumsbf 


ifOength1-0)( 






reserved 


8 


bslbf 


number_of_prograiii_;$equences 


8 


ulmsbf 


for (hO;i<huntber_ofj>rogram_sequencestl*+)i 






RSPN_prograiiiL^e4uence_^tart 


32 


uimsbf 


reserved 


48 


bslbf 


. vcRjm 


16 


bslbf 


nuinber_of_videos 


8 


uimsbf 


number_oCaudios 


8 


uimsbf . 


for Oi-^k<numberjo/jifideos^*+){ 






yideo_fitnsm_fTD 


16 


bslbf 


MideoCodtngliifoO 






•••)•■■• 












.andio_9(rcaiq_PIl> 


16 


bslbf 


AudioCodlngb^ 






1 












•).•• ■•• 






1 







FtG.54 



.iiMiidaAij^ 



EP1 1B8133A1 



SYNTAX 


NUMBER 




OFBYTES 


ABBREVIATION 


VideoCodingMoO ( 






vldeo_forinat 


8 


uimsbf 


fraine_rate 


8 


uimsbf 


dls|riay_aq|iccOratio 


8 


uiind>f. 


reserved 


8 


bslbf 


1 







FIG.55 



BNSOOCICh <EP 1 190133A1_L> 



EP 1188 133 A1 



video jformat 


MEANING 


0 


480i 


1 


576i 


2 


480pQnc1udinK 640X480p format) 


3 


lOBOi 


4 


720p 


5 


K)80p 


6-254 


reserved 


255 


No information 


FIG.56 


framejrate 


MEANING 


0 


forbidden 


1 


24000/1001 (23.^6...) 


2 


24 


3 


25 


4 


30000/1001 (29.»7..) 


5 


30 


6 


50 


7 


60000/1001(59.94..) 


8 


60 


9-254 


reserved 


255 


No information 



FIG.57 



87 



EP1 198 133 A1 



displayiaspecLratio 


MEANING 


0 


forbidden 


1 


reserved 


2 


4:3 display aspect ratio 


3 


16:9 display aspect ration 


4-254 


reserved 


255 


No information 



FiG.58 



88 



EP 1198 133 A1 



SYNTAX . 


NUMBER 


ABBREVIATION 


AudioCodinglnfoQ ( 






andiojionnat 


8 


utmsbf 


audio.component.type 


8 


uimsbf 


aampVtagJnqu^ncy 


8 


ulmsbf 


reserved 


8 


bslbf 


1 







FIG.59 



EP 1198 133 A1 



audio.coding 


MEANING 


0 


MPEG-1 audio layer I or II 


1 


Dolby AC-3 audio 


2 


MPEG-2AAC 


3 


MPEG-2 multi-cliannel audio, backward 
compatible to MPEG-1 


4 


SESPLPCM audio 


5-254 


reserved 


255 


No information 



FiG.60 



BN800CI0: <EP 1 198133A1J_> 



90 



EP1 198.133 A1 



audio.compqnenCtype 


MEANING 


0 


single mono channel 


1 


dual mono channel 


2 


stereo (2<:hanne0 


3 


multi-fingual, rnultiH:hannel 


4 


surround sound 


5 


audio description for the visually Impaired 


6 


audio for the. hard of hearing 


7-254 


reserved 


255 


No information 


FIG.61 


samplinfiLfrequency 


MEANING 


0 


48kHz 


1 


44.1kH2 


2 


32 kHz 


3-254 


reserved 


255 


No information 




9i . • • ■.- 



EP1 198133A1 




EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


CPIOl 






ver8ion_number 


8*4 


bslbf 


length 


32 


uimshf 


reserved 


15 


bslbf 


CPI_tyi)C 


1 


bslbf 


jf(CPLtype— 0) 






EPjnapQ 






else 






TU.imipO 






I 







FIG.65 



BNSOOCID: <EP 1108133A1J_» 



94 



EP 1198 133 A1 



CPlJype 


MEANING 


0 


EPmaptype 


1 


TU map type 



FIG.66 



Clip 

AV STREAM 



pts(xl) 
pts(yl) 



( Rt5(zl) 



P*^-<y25 , «x ptsiyn) 
pts(x2) 
I pts(z2) 



ptsCzm) 
{ Pts(xk) 



iiiiiiiiiiiiimii iiiiiiDiiiiiiii 



XI 



Yl 



X2 



^2 



Yn 



Xk 



RELATIVE 
"SOURCE 
PACKET 
NUMBER 



Zl 



Z2 



Zm 



: SOURCE PACKET CONTAINWG FIRST BYTE OF SEQUENCE 
HEADER video_PID-x 

. SOURCE PACKET CONTAINING FIRST BYTE OF SEQUENCE 
' HEADER video_PID-y 

. SOURCE PACKET CONTAINING FIRST BYTE OF SEQUENCE 
: HEADER video J>II)-z 



EPjtnap — ; . • — 

/ number_oC8tream/PIDs-3 

EP_mapJ6r_ EP_mapJfor_ 
one_strcain_PID (0) 



streamPlb(0)"X 
num_EP_entrie8 (0)« 



PTS_EP 


RSPN_EP 


start 


start 


ptstxl) 


XI 


pts(x2) 


X2 


ptsOdc) 


3ck . 



one^8tream^ID(l) 

stream_PID(l)=y A 
num.EP^entries (1) =n 



PTS.EP 


RSPN_EP 


stiart 


start 


ptsCyl) 


Yl 


ptsO^) 


Y2 


pts(yn) 


Yn 



EP_map_for_ 
one,stream^PID(2) 

8tream_PID(2)«z 



PTS_EP 


RSPN_EP 


start 


start 


pts(zl) 


Zl 


pts(z2) 


22 


pts (zm) 


Zm 



FIG.67 



95 



; ID:<6P 118B183Alj.> 



EP1 198 133 A1 



SOURCE PACKET 
REFERENCING 



SOURCE PACKET 
REFERENCING 



Clip 

AVSTREAM 



the STC^sequence #1^ 


^the STC^aequence #2^ 






) 1 








njp-o 









Xll Xln 



X21 X2in 



RSPN_STC.8tai1#l RSPN,STC_8tarti>2 



SOURCE 
PACKET 
NUMBER 



. SOURCE PACKET CONTAINING FIRST BYTE OF SEQUENCE 

• HEADER video_PID-x 

. SOURCE PACKET REFERENCED BY RSPN^STCstart 

• (DEFINED IN the STCJnto) 

EP„map_for_one_8terain_ FID 
video_PU>-x 



PTS_EP 


RSPN_EP 


start 


start 


ptsCxll) 


Xll 


ptsCxln) 


Xln 


pts(x21) 


X21 


pts(x2m) 


X2m 



\ DATA BELONGING TO 
j STC_sequence #1 

boundary 



RSPN^STC_8tart #2<X21 



DATA BELONGING TO 
y STC_8equenc^#2 

FIG.68 



CUp 

AVSTREAM 



video_PID-x video_PID-y video_PID-x 



program #1 program #2 program #3 



EP_map — ^ 

number_of_streamJPlDs-3 



RELATIVE 
SOURCE 
PACKET 
NUMBER 



EP_niap_for_ 
one_stream_PID(0) 



EP_map_for_ 
one_stream_PID(l) 



EP_map_for_ 
one_stream_PID (2) 





stream_PID(0)-x 




8tream_PID(l)-y 

- 




stream_PID(2)-x 

• •• 











FIG.69 



96 



BN8D0CID: <EP 110Bia3A1J_i 



• ■» • ... 

i 

■f 

EP1198133A1 



i 



SYNTAX 


NUMBER 
OP BYTES 


ABBREVIATION 


EP_inapOI 






reserved 


12 


bslbf 


EP_lype 


4 


uimsbf 


namber_of_streaniJPID5 


16 


uimsbf 


for (H'^;k<numberjc>/_^tream_J*IDs'M*+){ 






sbreamjnD(k) 


16 


bslbf 


numJSFjentri9s(k) 


32 


uimsbf 


EP_inapJor.onejBtreamJPIDj5tart.address^A; 


32 


uimsbf 


] 






for a=0;i<X;i++){ 






p8dcling_\vdrd 


16 


bslbf 


) 






for (k«0;k<wOTx6cr_«)^rtrcflm_P/D5;k++) 1 






EP_inap_for_one_streani_PID(mim^/>_enir;«jC*:J) 






for(i-0;i<y^++)r 






padding_word 


16 


bslbf 


1 . , 






1 













FiG.70 



. i 

6N$ - > ID: <EP. 



97 

.119ei33A1J.> 



EP1 198 133 A1 



EP_type 


MEANING 


0 


video 


1 


audio 


2-15 


reserved 



FIG.71 



BN80OCID: <EP 1188133A1 J.» 



96 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OFBYIES 


ABBREVIAHON 


EP_mapJ6r^one_8treamJ*ID(A/) { 






forO-0;i<Ar;i+^)f 






PTSJBPjrtart 


32 


uim3bf 


R5FN^P_5tart 


32 


uimsfaf 


I 






) ' ^ ■ 







FrG.72 



.1 



I 



99 



BUB >tOc<EP ^1igeiS3A1_L> 



EP1 198 133 A1 




EP 1196 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TU_inapO{ 






o£rset_time 


32 


bslbf 


timejuiiljrfze 


32 


uimsbf 


nuinber_of_tiine_uiilt.entiie8 


32 


uimshf 


. for Q!i'0')ii<mmberjotfjiime_tudt_<eiUrtes'^+^) . 






RSPJN_tiine_niiitLstart 


32 


uimsbf 


1 







FIG.74 



101 



EP1 198133A1 



SYNTAX 


NUMBER 
OFBVTES 


ABBREVIATION 


ClipMarkOI 






versIon_namber 


8*4 


bslbf 




32 


uimsbf 


number.of.Cllp.ntarks 


16 


uimsbf 


for (i"0; i<numbar_o/jcl^.jnarks; 






reserved 


8 


bslbf 


marfc.type 


8 


bslbf 


niark_time.^inp 


32 


uimsbf 


STCjBcqnenceJd 


8 


uimsbf 


reserved 


24 


bslbf 


chamcterjset. 


8 


bslbf 


namejength 


8 


uimsbf 


inark_nanie 


8*256 


bslbf 


ref_thurabnailjndex 


16 


uimsbf 


I 






\ 







FIG.75 



102 



EP 1 198 133 A1 



MarK_type 


MEANING 


COMMENT 


(bcO(Wx8F 


reserved 


Reserved for PlaylistMarkO 


0x90 


Event-start maik 


MARK POINT INDICATING PROGRAM START POIN^ 


0x91 


Local event-start marie 


MARK POINTINDiaHNGLOCALSCENE IN PROGRAM 


0x92 


Scene-start mark 


MARKFOINTSHOWINGSCENECIIANGEPOINT 


03c93^)xFF 


reserved 





FIG.76 



103 



EP1 198 133 A1 



CPI_type 

in the PlayListO 


SEMANTICS 0FmarK.time.8tatnp 


EP_inap type 


mark_tiine_stamp MUST INDICATE UPPER 32 BITS OF 33 
BIT LENGTH FTS CORRESPONDING TO PRESENTATION 
UNIT REFERENCED BY MARK. 


TU_map type 


markwtime.stamp MUST BE TIME ON TU^map^tlme.axis 
AND MUST BE ROUNDED TO time.unit PRECISION. 
mark_time_stamp IS CALCULATED BY FOLLOWING 
EQUATION: 

marliLtime.stainp - TU_start_tune %2^^ 



FIG.77 



104 



EP1 1M133A1 



SYNTAX 


NUMBER 
OFBVTES 


ABBREVIXnON 


menu.thmb/mark.thmb ( . 






. . reserved 


256 


bslbf 


TihiiiiilMiaaO 






for 0-0;>i<Nl; i++) 






paddbigjword 


16 


bslbf 


). 







FIG.78 



105 



EP1 198 133 A1 



SYKTAX 


NIIMRPP 
INUMDCJv 

0FBY7ES 


ABBREVIATION 


ThumbnaUOl 






versionjnumber 


»*4 


char 


length 


32 


uimsbf 








tn_bIock5.jtort_&ddre8S 


32 


bslbf 


number_of_thuinbnaib . 


16 


uimsbf 


fn^blockjiiize 


16 


uimsbf 


number^of^tii^blocks 


16 


uimsbf 


reserved 


16 


bslbf 


for G^O; i<numberjafj^umbnailsi ( 






thumbnalLlndex 


16 


uimsbf 


thumbnaiLpicturcformat 


8 


bslbf 


reserved 


8 


bslbf 


picture data size 


32 


uimsbf 


start^ti^blockjnumber 


16 


uimsbf 


x_picture_Iengtli 


16 


uimsbf 


yj>icturejragth 


16 


uimsbf 


reserved 


16 


uimsbf 


) 






stufllnL.bytes 


8*2*L1 


bslbf 


forOk-O; \i<numberjofjnJbhcks\ k++) { 






tnjblock 


th_blocK_ 
aize*1024*8 




) 






} 






} 







FIG.79 



106 



BNSOOCtD: <EP 1106133A1J.> 



EP1 198 133 A1 



Thumbnail j>icturejbnnat 


MEANING 


0x00 


MPEG-2 Video 1-picture 


0x01 


DCF (restricted JPEG) 


0x02 


PNG 


0x03^ 


reserved 



FIG.80 



FIG.81A 



FIG.81 B 




.107 



EP1 198 133 A1 



DVR MPEG-2TRANSP0RT STREAM 



Aligned 

unit 


Aligned 
unit 


Aligned 
unit 




Aligned 
unit 


Aligned 
. unit 


6144 
^ BYIES ^ 













SOURCE 
PACKET- 0 


SOURCE 
PACKET- 1 


SOURCE 
PACKET- 2 




SOURCE 
PACKET- 31 




192 
, BYIES . 

< 








TP_extra 
header 


TRANSPORT 
PACKET 




^ BYTES 1 


188 1 
^ BYTES 1 



FIG.82 



108 



Et>1198 133 A1 




CO 
00 

2 

UL 



109 



/119ei33AlJ.> 



EP1 198 133 A1 




110 

BNSDOCIO: <EP l10Bl3aAlJ> 



EP1198133A1 



SYNTAX 


NUMBER 
OFBYTES 


ABBREVIAHON 


sourc^acketO { 






TPjextriLJieaderO 






. traiisportLpack«tO 






} 







FI&85 



9N8 ' \0: <EP__119eiaaA1J^ 



111 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OFBYTES 


ABBREVIATION 


TP_extra_headerO ( 






copy-PcrmissionJIndicator 


2 


uimsbf 


«iTivaLtime_j8tamp 


30 


uimsbf 


1 







FIG.86 



BNSOOCIO: <EP 119ai3aAl_L» 



112 



EP1 198133 At 



copyjpermlsslon 
^indicator 


MEANING 


00 


copy free 


01 


no more copy 


10 


copy once 


11 


copy prohibited 




* I 

1 

j 

• » 

i 



■ 113 

\ . ' ' ' • . ' . 

" - - • K>:<EP ^l1W13aA1J_> ' ■ . "..isfe 

• • . - . . f.-. .1 . . ..... .... ^ . t . i- ..'.-..'»<' 



EP1 198 133 A1 




BN800CID: <EP 118ei3aA1.L> 



114 



EP1 198 133 A1 




8N8D0CI0: <EP. 



.ii9ei3aAix» 



116 



EP1 198133A1 




BNSOOCID: <6P 119ei33AlJ.> 



118 



EP1 198 133 A1 




EP1198133A1 




EP11S8133A1 



j7t 



27MHz 
X*tal 



2mm 

FREQUENCY 



d? 

ARRIVAL 
TIME 
CLOCK 
COUNTER 



DVR 
DRIVE 



Rniax 



arrvaLdme.clockO) 



'INITIAL 
VALUE 



SOURCE 
PACKET 
a)VRMPEG2 



j75 



SMOOTHING 




SOURCE 


BUFFER 




DEPACKETIZER 



Rpkl 



^TRANSPORT 
PACKET 
(MFEG2TS) 



78 



7 7\ Rxl \ Rbxl /7 9 



TBI ~ 



MBl 



- EBl 



:5pEoi 

Dl 




C81 



Pi(k) 



7o 
76 



TBn 


Rxn 


Bn 





80 

jr84 p^UDIO 




-oPnOO 



TBsys 


Rxsys 


Bsys 






85 

SYSTEM 
CONTROL 

88 



FIG,96 



122 



EP 1 198 133 A1 



SOURCE 
PAKETOF 
TSl 



SOURCE 
PAKETOF 
ATCl! /TS2 



TSl. I 

TS2 I 

VIDEO 
FRESENTATION 
UNIT OF TSl 



VIDEO 
PTSs 

AUDIO 
PTSs 



AUDIO 
PRESENTATION 
UNTTOFTSl 



i 



ATC2 



□□□□□□□□□□□ 




srci' 

OVERLAP 

■ 1 



Tl 




pTs»;„d+Hpp 



T 

FTS^; 



-STC2 



start 



A \- 



T4 i 



-TIME 



lASTVIDEO PACKET OF AUDIO 
TSl INPUT TO DVR STD OVERLAP 

• • • 

T3 T5 



FIG.97 



.ii9ei^ij^> 



123 



EP1198 133 A1 



SYNTAX 


NUMBER 
OPBYTES 


ABBREVIATION 


xxxxx.rpls / yyyyy.vpls { 






versioiunumber 


8*4 


bslbf 


PlayLlstjBtait-address 


32 


uinisbf 


PlayListMarlUrtart_^ddress 


32 


uimsbf 


Maker8privateData.jrtart.addres8 


32 


uimsbf 


reseived_forjfuture_use 


160 


bslbf 


UIAppInfoPlayListO 






forO-0;i<Nl;i++)| 






padding_word 


16 


bslbf 


) 






PlayLlstO 




• 


forO-0;i<N2;l++)( 






paddlng_.word 


16 


bslbf 


1 






PlayLlstMarkO 






for 0-0:i<N3:i++)( 






paddlnft_word 


16 


bslbf 


) 






MakcrsPrivateDataO 






forO-0;i<N4;i++)j 






padding_word 


16 


bslbf . 


1 






) 







FIG.98 



BN800CI0: <ep 119ei3aA1J^ 



124 



EP1 198133A1 



SYNTAX 


NUMBER 
OFBYTES 


^BSEVUOTON 


UIAppInfoPlaylistOI 






length 


32 


uimsbf . 


PlayListjservtce.type . 






PlayLisCcharacterjset 


8 


uimsbf 


reservedjor.word^align 


3 


bslbf 


playback^controLflag 


1 


uimsbf 


MTitauprotectjO^ 


1 


uimsbf 




1 


uimsbf 


archive 


2 


uimsbf 


recor^tlme.and_date 


4*14 


bslbf 


duration 


4*6 


bslbf 


maker_ID 


16 


uimsbf 


inaker.jiioddLcode 


16 


uimsbf 


ref_tfauiRbiiaIUiidex 


16 


uimsbf 


reserved 


7 


bslbf 


rp_liifo^vaiid_fIag 


1 


uimsbf 


rp_ref^to_PlayItemJd 


16 


uimsbf 


rp^time^stamp 


32 


uimsbf 


cbanneLnumber 


16 


uimsbf 


r^rvedjbr.word.align 


8 


bslbf 


channeLnameJengtb 


8 


uimsbf 


chaiiiiel_nanie 


8*20 


bslbf 


PlayList^ameJengtb 


8 


uimsbf 


PlayListjiiame 


8*255 


bslbf 


Pfa^LlsLdetaUJength 


16 


uimsbf 


PlayLi$t_detaU 


8*1200, 


bslbf 


) 







FIG.99 



125 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


myListOt 






length 


32 


— TT— 

uimsbf 


reservedjor^word^align 


15 


DSlbl 


CPLtype 


1 


DSlDI 


number.ot.nayItems 


16 


uimsDi 


u (<Vfermfl/ PlayUso && CrLtype*-0) { 






number.of^ubPliiyltenis 


16 


mmsDi 


lelsei 






reBcivcQjor^wora^aji^n 


io 




} 






for (JPlayltemJd^O: 

PlayUemJd<nymberj>fJ>layItems; 
PlayItemJd+*){ 






PlayltemO 






) 






if i<Vlrtual PlayUst>&& CPLtype— 0) { 






for (i-0; i<nuniber_ofJ5ubPlayItemr, 






SnbPlaylteinO 






) 






) 






1 







FIG.100 



BNSOOCID: «EP 110B»33A1_L> 



126 



i 

EP1 198133A1 



SYNTAX 


NUMBER 
OFBTTES 


ABBREVIATION 


SubFlayltemOi 






length 


16 


uimsbf 


Clipjnformation^lejnaine 


8*10 


bslbf 


SubPath_typiB 


8 


bslbf 


STC_^iience_id 


8 


uimsbf 


SubPath_IN_time • 


32 


uimsbf 


SubPath_OUT»time 


32 


uimsbf 


8ync_PlayItemJd 


16 


uimsbf 


sync.starCPTS^oLPlayltem 


32 


uimsbf 


1 







FIG.101 



BM8 itticep iiesiaaAij_> 



127 



EP1 198133A1 



c 



STAiO' FORMULATING ^ 
Real Playlist J 

T 



RECORD Clip AV STREAM 



Sll 



<(CAN EP,niap BE FORMULATED ?^ 



S12 
NO 



YES 



S13 



FORMULATE EP_map 



$14 



FORMULATE TU_map 



SETPbyUstCPLtype 



I 



FORM PlayDstO CONSISTING OF Playltem 
COVERING ALL REPRODUCIBLE RANGES 

OF ABOVE aip. IF CPLtvpe IS EP.map 
TYPE, SET-nME INFORMATION BYPTS 
BASE. IF CPI_type IS TU_map TYPE, SET 
TIME INFORMATION ON ARRIVALTIME 
BASIS. 



I 



S16 



FORMULATE UL^ppIiifoPlayUstQ 



FORMULATE PlayListMarkO 
I 



FORMULATE MakersPrivatePataO [ -^S19 



1 



R ECORD R eal PlayUst FILE 
I 



] — S20 



END ^ 



FIG.102 



128 



EP1 198 133 A1 



c 



START FORMUIATING 
. Virtual FtoyUst . 



USER SPECIFIES 0N£ Real PlayUst FROM 
REPRODUCTION DOMAIN OF Real PlayUst, USER 
SELECTS REPRODUCTION DOMAIN AT IN AND 
OUT POINTS. IF CPLtype IS EP_niapTYFE. SET 
TIME INFORMATION ON PTS BASIS AND, IF 
CPLtype IS TU_inap TYPE, SETTIME INFORMATION 
ON ARRIVALTIME BASIS. 



S31 



i 



REPRODUCTION DOMAIN SPECIFYING 
OPERATION BY USER END ? 




USER OR RECORDING DEVICE SETS 
connectioD_condition BETWEEN TWO 
CONSECUTIVELY REPRODUCED 
REPRODUCTION DOMAIN 



S32 



S33 



IF CPLtype IS EPjnap TVPE, USER SPECIFIES 
SUB-PATH INFORMATION (AUDIO FORAFTER 
41EC0RDING) (OPTION) 



T 



FORMULATE PlaylistO BASED ON USER 
SPECIFIED REPRODUCTION DOMAIN 
INFORMATION AND connection^condttion 



I 



$34 



^S35 



FORMULATE UIAppInibPlayUstO 



FORMULATE PlayUstMarkQ 



I 



FORMULATE MakersPrivateDataO 



I 



RECORD Virtual PlayUst FILE 
T 



^S36 
S37 
S3d 
S39 



FIG.103 



129 



EP 1198 133 A1 



r START ") 

T 



PLAYER ACQUIRES INFORMATION OF 
Info.dvr, Cfip Information file, Pl^List file AND 
THUMBNAIL FOE TO FORMUUTE GUI PICTURE 



S51 



± 



PRESENT ON GUI PICTURE INFORMATION 
EXPLAINING PlayUst BASED ON 
UIAppInfoPIayUstO OF EACH PlayUst 



352 



USER SPECIFIES REPLAY OF ONE PlayDst 



SS3 



IFCPLtype IS EP^map T5fPE, ACQUIRE SOURCE PACKET 
NUMBER WHERE THERE IS ENTRY POINT 
TEMPORALLY BEFORE AND CLOSETTO IN time. 
IF CPLtype ISTU_map TYPE, ACQUIRE SOURCE 
PACKET NUMBER WHERE BEGINS TIME UNIT 
TEMPORALLY BEFORE AND CLOSESTTO IN time 
FROM IN.time OF CURRENT Playltem. 



854 



READ OUT DATA OF AV STREAM FROM SOURCE 
PACKET NUMBER OBTAINED AT ABOVE STEP 
TO SUPPLY ITTO DECODER 



I 



PERFORM CONNECTION PROCESSING OF 
DISPLAY WriH TEMPORALLY PREVIOUS Playltem 
IN ACCORDANCE WITH connection.condition 



I 



IF CPLtype IS EP.map TYPE, DECODER STARTS 
DISPLAY FROM IN_time FTS PICTURE. IF 
CPLtype IS TU_map TYPE, DECODER STARTS 
DISPLAY FROM PICIURE SUBSEQUENTTO 
INtime 



S56 



S57 



I 



CONTINUE DECODING AV STREAM 




'S58 



OUr_time ? 
♦ YES 



y 



NO 



DISPLAY 
PICTURE 



S60 



LAST Playltem? 
♦ YES " 
Q END ) 



> 



NO 



FIG.104 



130 



BNSDOCta «EP_ 



_tieB13aAl_L> 



EP1 198139A1 



(start SUB-PATH REPLAY^ 
T 1 



ACQUIRE SubPlayltem INFORMATION 



S71 



ACQUIRE SOURCE PACKET NUMBER WHERE 

THERE IS ENTRY POINTTEMPORAIXY 
BEFORE AND CLOSESTTO SubP^tlUN time 



READOUT DATA OF AV STREAM OF SUB-PATH 
FROM SOURCE PACKET NUMBER WHERE 
THERE IS ABOVE ENTRY POINTTO SUPPLY 
ITTO DECODER 



I 



$72 
$73 



WHEN Main PATH REPLAY IS PICTURE SHOWN 
BY syncJPIayltemJd AND 
sjmc_8tarLPTS_pCPIayItem 
START SUBPATH DISPLAYING 



874 



CONTINUE DECIDING 
SUB-PATH AV STOEAM 



S76-<I1 



I 



S7S 



<C SubPath_OUT_time ? ^ 



NO 



DISPLAY 
SUB-PATH 



377 

1 



^YES 
( END ^ 



FIG.105 



131 

1D:<EP ;.1108133A1J_> 



EP1 198133A1 



c 



STAKT FORMULATING ^ 
PlayUstMark J 



PLAYER ACQUIRES INFORMATION OF 
Info.dvr. Clip Information ffle. HayListfile 
AND Thumbnail file TO FORM GUI PICTURE 



S91 



USER COMMANDS REPLAY OF ONE PlayList 



I 



START REFIAY OF COMMANDED PlayUst REPLAY 



1 



USER COMMANDS MARK SET AT FAVORITE 
SCENE 



>S9d 



S94 



IF CPIJype IS EP.map, ACQUIRE MARK PTS 
AND Playltem Jd OF Playltein IT BELONGS. 
IF CPLtype IS TU.map, ACQUIRE MARK 
POINT ARRIVALTIME. 



I 



STORE MARK INFORMATION 
IN PlayListMarkO 



RECORD PlayDstFILE 



E 



( ^ ) 



595 



■S96 



■S97 



FIG.106 



132 



EP1 198 133 A1 



c 



START LOCATING REPLAY 
USING PlayUstMark 

" 



0 



USER ACQUIRES INFORMATION OF 
Info.dvr, Clip Information file, Playlist file AND 
ThumbnaiffUe TO PREPARE GUI PICTURE 



I 



Sill 



USER COMMANDS REPLAY OF ONE PlayUst \ :^S112 



DISPLAY ON GUI UST OF THUMBNAIL 
GENERATED FROM PICTURE 
REFERENCED IN PlayUstMark 



± 



USER SPECIFIES MARK POINT OF REPLAY 
START POINT 



I 



IF CPL^ IS EP.mapTYiPE, ACQUIRE MARK 
PIS AND Playltemjd IT BELONGS, IF CPLtype IS 
TUjnap TYPE, ACQUIRE MARK ATS 
(Arrival Time Stamp) 

\ 



8113 



SlU 



S115 



IP CPLtype IS EP_mapTyPE, ACQUIRE 
STC^uence4d OF AVSTERAM REFERENCED 
BY Playltem SPECIFIED BYPlayItem_id 



S116 



IF CPLlype IS EP_mapTyPE, INPOTTO 
DECODER AV STREAM BASED ON ABOVE 
ST&sequenoe-id AND MARK PTS. IF CPI_lype 
IStU^mapTYPE. INPUTTO DECODER AV 
STREAM BASED ON MARK ATS 



I 



S117 



IF CPLtype IS EP_raapTYPE, START DISPLAY 
FROM PICTURE OF MARK POINT PTS. IF 
CPLtype ISTU_mapTYPE. START DISPLAY FROM 
PICTURE SUBSEQUENTTO MARK POINT ATS. 

E 



FIG.107 



Slid 



133 



EP1 198 133 A1 




134 



EP 1 1M 133 A1 



INTERNATIONAL SEARCH REPORT 



ipp W i ' Miu a wow 
PCt/JP01/p3417 



A OASSinCAIlONOFSUBJECrMATrER 

Int.Ca^ a041f 5/93, OllB 20/10 



Acconfing to jnfcnmrinifvat Pitaat CiMsifiraHmi <1PQ » to bo<h oitU^ chitiBflttion wd ffC 



B, FIELDS SEARCHED 



«iWhed (digritetten nyrtam ftltoiwd by < ^ 

Zat.Cl^ BOW 5/76-5/9S6, 7/34-7/68, OllB 20/10-30/12 



iJitsuyo Shlnan l(bbo 1922-1996 
Kblcoi Jitsuyo Shinan Kokio 1971-2001 



ToEoku Jitsuyo Sbinan Roho 1994-2001 
Oltmxyo Shixsm Toro^cu Xotao 1990-2001 



<X IX>CUMBhnSC0N^BR8b TO RELEVANT 



Qlitteii of ^toflciimi^ wife ladiorfoii^ ^jtewp ippwprirtBt of Ifap wbwml pwgcs 



Kfilsvni to cliin No; 



OP, 2001-157145, A (Sony oorporatlon) I 

Od Jtue, 2001 (06.06.01). 

Tuli t«xt/ Pigs. 1 to 29 (Pwsilyt nan«) 

jPf 11-243517, A CSoxiy Oorporation) , 

07 8epteBiber« 1999 (07.09.99) • 

Pull text; Pigs. 1 to 4 (Pamilyi none) 



1-14 



1-14 



^^^^^^n^^^^^^^i I !■ ■ iir* ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

"A* dooiinMrtddbitigilMssiMmffti^ 
coBtttaBtf ID be orptcttoUu ntoivsQM 

docannMiwUoliJn^if ftnwdPibtB adpdodty difciM 
tiltd CO efttWA lh> piAlodiM dale ofKkOther otifldAa Of aiWr 
lpc cMicMoo(ia ipcoiflo^ 
^OT ti of mnwit to » owl cBicfcmnB^ w di tt i tfo a croitay 



n Boopatsst&mflyttusz. 

pfiori^ €hlo Msl not Id confUol wMi fto i^^BoitfoQ nitcitod lo 

i^p ^dn tbo doouDMSl ii iikn obM 
*^ dooQMAofy«niealirNlimot;tiM0]«tnodlMr^^ 
Ottwidttod.to invoivo M inmothroMip tt« doowa^ 



12 June, 2001 (12.06.01) 



Data of nailing of da iKtMotioia] sBtnk 
19 June, 2001 (19.06.01) 



KimaadaaiUiSStfdKen <tf (he JSA/ 
Japanese Pat^mt Office 

ItafaaileNo. 



TfliepbonoHo. 



FaoiPCinSA/310(iaconddieet) (Ju^ 1992) 



135 



